Skip to content

Share FSST symbol table state between executed variants of arrays.#8222

Merged
AdamGS merged 2 commits into
developfrom
adamg/bump-fsst
Jun 2, 2026
Merged

Share FSST symbol table state between executed variants of arrays.#8222
AdamGS merged 2 commits into
developfrom
adamg/bump-fsst

Conversation

@AdamGS

@AdamGS AdamGS commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Summary

This PR has two changes:

  1. Bumps the FSST dependency to include 0.5.11 which has faster Compressor::rebuild_from.
  2. When executing an FSST array through slice/filter/take, we keep the compressor instead of creating new lazy instances, as part of a FSSTSymbolTable type.

@AdamGS
Bump FSST version explicitly
5b91643 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done afd4751 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done e5f6e43 1 Explore Profiling Data
🟢 Done 5b91643 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.992x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.992x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 115300835 109306197 1.05
polarsignals_q01/datafusion:vortex-file-compressed 262725820 268509295 0.98
polarsignals_q02/datafusion:vortex-file-compressed 21080022 23109238 0.91
polarsignals_q03/datafusion:vortex-file-compressed 285922191 278471743 1.03
polarsignals_q04/datafusion:vortex-file-compressed 10742144 10354000 1.04
polarsignals_q05/datafusion:vortex-file-compressed 14182902 14134508 1.00
polarsignals_q06/datafusion:vortex-file-compressed 17450273 18119846 0.96
polarsignals_q07/datafusion:vortex-file-compressed 13072416 13356681 0.98
polarsignals_q08/datafusion:vortex-file-compressed 403610978 389602990 1.04
polarsignals_q09/datafusion:vortex-file-compressed 10046284 10733086 0.94

No file size changes detected.

@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.992x ➖, 1↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5223235 5308871 0.98
fineweb_q01/datafusion:vortex-file-compressed 32201872 30625389 1.05
fineweb_q02/datafusion:vortex-file-compressed 36768368 37791917 0.97
fineweb_q03/datafusion:vortex-file-compressed 🚀 63406771 71532425 0.89
fineweb_q04/datafusion:vortex-file-compressed 276382541 281372716 0.98
fineweb_q05/datafusion:vortex-file-compressed 216158861 219653619 0.98
fineweb_q06/datafusion:vortex-file-compressed 50224289 47437350 1.06
fineweb_q07/datafusion:vortex-file-compressed 53333625 51634166 1.03
fineweb_q08/datafusion:vortex-file-compressed 19502349 19823759 0.98
datafusion / vortex-compact (0.983x ➖, 1↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5365009 5578313 0.96
fineweb_q01/datafusion:vortex-compact 94699631 94626108 1.00
fineweb_q02/datafusion:vortex-compact 🚀 98847654 120587828 0.82
fineweb_q03/datafusion:vortex-compact 861773389 863457931 1.00
fineweb_q04/datafusion:vortex-compact 922127930 912620180 1.01
fineweb_q05/datafusion:vortex-compact 818725954 815027075 1.00
fineweb_q06/datafusion:vortex-compact 473123040 459457616 1.03
fineweb_q07/datafusion:vortex-compact 484383150 485871286 1.00
fineweb_q08/datafusion:vortex-compact 19207585 18360059 1.05
datafusion / parquet (0.990x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6289221 6161980 1.02
fineweb_q01/datafusion:parquet 287485870 301464867 0.95
fineweb_q02/datafusion:parquet 296048688 298287669 0.99
fineweb_q03/datafusion:parquet 293887093 279012247 1.05
fineweb_q04/datafusion:parquet 302027018 300629883 1.00
fineweb_q05/datafusion:parquet 290359761 299223433 0.97
fineweb_q06/datafusion:parquet 283290725 301702080 0.94
fineweb_q07/datafusion:parquet 277795068 283501202 0.98
fineweb_q08/datafusion:parquet 275562676 274849846 1.00
duckdb / vortex-file-compressed (0.992x ➖, 1↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3530225 3352706 1.05
fineweb_q01/duckdb:vortex-file-compressed 32395711 32553209 1.00
fineweb_q02/duckdb:vortex-file-compressed 40813364 38955496 1.05
fineweb_q03/duckdb:vortex-file-compressed 🚀 129892076 163686841 0.79
fineweb_q04/duckdb:vortex-file-compressed 273412237 268173134 1.02
fineweb_q05/duckdb:vortex-file-compressed 215011717 213726998 1.01
fineweb_q06/duckdb:vortex-file-compressed 51394448 50920052 1.01
fineweb_q07/duckdb:vortex-file-compressed 54584116 55333482 0.99
fineweb_q08/duckdb:vortex-file-compressed 22408141 21510076 1.04
duckdb / vortex-compact (1.015x ➖, 0↑ 1↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4157856 4223169 0.98
fineweb_q01/duckdb:vortex-compact 🚨 116293200 100504676 1.16
fineweb_q02/duckdb:vortex-compact 115075346 115654998 0.99
fineweb_q03/duckdb:vortex-compact 864985506 853918201 1.01
fineweb_q04/duckdb:vortex-compact 896361029 899376900 1.00
fineweb_q05/duckdb:vortex-compact 801625623 801196735 1.00
fineweb_q06/duckdb:vortex-compact 462921651 466824631 0.99
fineweb_q07/duckdb:vortex-compact 479265903 483613531 0.99
fineweb_q08/duckdb:vortex-compact 19838736 19458682 1.02
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 29148644 32131628 0.91
fineweb_q01/duckdb:parquet 85814957 84673143 1.01
fineweb_q02/duckdb:parquet 84665760 85042258 1.00
fineweb_q03/duckdb:parquet 315594485 319773840 0.99
fineweb_q04/duckdb:parquet 448498483 445519380 1.01
fineweb_q05/duckdb:parquet 415121403 414400838 1.00
fineweb_q06/duckdb:parquet 201294110 204927428 0.98
fineweb_q07/duckdb:parquet 216517487 215429241 1.01
fineweb_q08/duckdb:parquet 32934527 32256846 1.02
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 421.83 KB -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -3.8% -3.8% -0.0% +49.7% ➖ noise
0 datafusion:vortex-file-compressed -1.6% -3.8% +2.2% +53.4% ➖ noise
0 duckdb:vortex-compact -1.5% -3.8% +2.3% +54.8% ➖ noise
0 duckdb:vortex-file-compressed +5.3% -3.8% +9.4% +79.5% ➖ noise
1 datafusion:vortex-compact +0.1% -1.7% +1.8% +15.3% ➖ noise
1 datafusion:vortex-file-compressed +5.1% -1.7% +7.0% +31.1% ➖ noise
1 duckdb:vortex-compact +15.7% -1.7% +17.7% +13.5% 🚨 regression
1 duckdb:vortex-file-compressed -0.5% -1.7% +1.2% +46.2% ➖ noise
2 datafusion:vortex-compact -18.0% -0.6% -17.5% +21.3% ➖ noise
2 datafusion:vortex-file-compressed -2.7% -0.6% -2.1% +12.6% ➖ noise
2 duckdb:vortex-compact -0.5% -0.6% +0.1% +15.4% ➖ noise
2 duckdb:vortex-file-compressed +4.8% -0.6% +5.4% +10.0% ➖ noise
3 datafusion:vortex-compact -0.2% +2.0% -2.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -11.4% +2.0% -13.1% +26.5% ➖ noise
3 duckdb:vortex-compact +1.3% +2.0% -0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -20.6% +2.0% -22.2% +41.9% ➖ noise
4 datafusion:vortex-compact +1.0% +0.6% +0.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.8% +0.6% -2.3% +10.0% ➖ noise
4 duckdb:vortex-compact -0.3% +0.6% -0.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.0% +0.6% +1.4% +10.0% ➖ noise
5 datafusion:vortex-compact +0.5% -1.4% +1.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.6% -1.4% -0.2% +10.0% ➖ noise
5 duckdb:vortex-compact +0.1% -1.4% +1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.6% -1.4% +2.0% +10.0% ➖ noise
6 datafusion:vortex-compact +3.0% -4.0% +7.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.9% -4.0% +10.2% +12.9% ➖ noise
6 duckdb:vortex-compact -0.8% -4.0% +3.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.9% -4.0% +5.1% +16.4% ➖ noise
7 datafusion:vortex-compact -0.3% -0.8% +0.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +3.3% -0.8% +4.1% +11.5% ➖ noise
7 duckdb:vortex-compact -0.9% -0.8% -0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.4% -0.8% -0.6% +20.5% ➖ noise
8 datafusion:vortex-compact +4.6% +1.2% +3.4% +25.4% ➖ noise
8 datafusion:vortex-file-compressed -1.6% +1.2% -2.8% +20.6% ➖ noise
8 duckdb:vortex-compact +2.0% +1.2% +0.8% +39.7% ➖ noise
8 duckdb:vortex-file-compressed +4.2% +1.2% +3.0% +21.7% ➖ noise

@codspeed-hq

codspeed-hq Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will improve performance by 52.47%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 18 improved benchmarks
❌ 4 regressed benchmarks
✅ 1253 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_bool_canonical_into[(1000, 10)] 30.6 µs 45.5 µs -32.83%
❌ Simulation chunked_varbinview_canonical_into[(1000, 10)] 161.6 µs 197.8 µs -18.29%
❌ Simulation chunked_varbinview_into_canonical[(1000, 10)] 176.2 µs 212.4 µs -17.02%
❌ Simulation bitwise_not_vortex_buffer_mut[128] 246.1 ns 275.3 ns -10.6%
⚡ Simulation pushdown_compare[(1000, 16, 4)] 344.8 µs 141.1 µs ×2.4
⚡ Simulation pushdown_compare[(1000, 64, 4)] 345.8 µs 141.5 µs ×2.4
⚡ Simulation pushdown_compare[(1000, 4, 4)] 344.8 µs 141.3 µs ×2.4
⚡ Simulation pushdown_compare[(1000, 4, 8)] 349.6 µs 145.2 µs ×2.4
⚡ Simulation pushdown_compare[(1000, 64, 8)] 351.7 µs 147.2 µs ×2.4
⚡ Simulation pushdown_compare[(1000, 16, 8)] 357.3 µs 153.1 µs ×2.3
⚡ Simulation pushdown_compare[(10000, 16, 4)] 418.2 µs 221.3 µs +88.98%
⚡ Simulation pushdown_compare[(10000, 64, 4)] 417.1 µs 221 µs +88.77%
⚡ Simulation pushdown_compare[(10000, 4, 4)] 418.1 µs 221.6 µs +88.66%
⚡ Simulation pushdown_compare[(10000, 4, 8)] 423.5 µs 227.7 µs +85.95%
⚡ Simulation pushdown_compare[(10000, 64, 8)] 424.2 µs 228.3 µs +85.84%
⚡ Simulation pushdown_compare[(10000, 16, 8)] 459.7 µs 263.6 µs +74.4%
⚡ Simulation baseline_eq[4, 65536] 237.9 µs 185.1 µs +28.52%
⚡ Simulation baseline_lt[16, 65536] 275.5 µs 217.6 µs +26.61%
⚡ Simulation baseline_lt[4, 65536] 253.2 µs 200.9 µs +25.99%
⚡ Simulation eq_pushdown_low_match 1,152.4 µs 955.5 µs +20.6%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing adamg/bump-fsst (afd4751) with develop (84a4a3f)

Open in CodSpeed

@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.9%, environment too noisy confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49602984 51974384 0.95
tpch_q02/datafusion:vortex-file-compressed 23032959 23484293 0.98
tpch_q03/datafusion:vortex-file-compressed 28183404 28319003 1.00
tpch_q04/datafusion:vortex-file-compressed 20181667 20465680 0.99
tpch_q05/datafusion:vortex-file-compressed 49409720 50292252 0.98
tpch_q06/datafusion:vortex-file-compressed 10753009 10300465 1.04
tpch_q07/datafusion:vortex-file-compressed 56025870 55947083 1.00
tpch_q08/datafusion:vortex-file-compressed 40900951 41152785 0.99
tpch_q09/datafusion:vortex-file-compressed 53101370 52121004 1.02
tpch_q10/datafusion:vortex-file-compressed 43908773 44242814 0.99
tpch_q11/datafusion:vortex-file-compressed 16322685 16692064 0.98
tpch_q12/datafusion:vortex-file-compressed 24848782 24653958 1.01
tpch_q13/datafusion:vortex-file-compressed 27012595 26585804 1.02
tpch_q14/datafusion:vortex-file-compressed 15475405 15984543 0.97
tpch_q15/datafusion:vortex-file-compressed 24564695 24996022 0.98
tpch_q16/datafusion:vortex-file-compressed 20550995 20292321 1.01
tpch_q17/datafusion:vortex-file-compressed 66332189 67253357 0.99
tpch_q18/datafusion:vortex-file-compressed 83028043 81960499 1.01
tpch_q19/datafusion:vortex-file-compressed 21120903 21767504 0.97
tpch_q20/datafusion:vortex-file-compressed 30359079 29340065 1.03
tpch_q21/datafusion:vortex-file-compressed 71625973 73418946 0.98
tpch_q22/datafusion:vortex-file-compressed 11631335 11857208 0.98
datafusion / vortex-compact (0.986x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57903668 57449592 1.01
tpch_q02/datafusion:vortex-compact 26401613 27136931 0.97
tpch_q03/datafusion:vortex-compact 28826931 29434693 0.98
tpch_q04/datafusion:vortex-compact 22824843 22497281 1.01
tpch_q05/datafusion:vortex-compact 51050347 52103615 0.98
tpch_q06/datafusion:vortex-compact 12113007 12519669 0.97
tpch_q07/datafusion:vortex-compact 59240199 59953307 0.99
tpch_q08/datafusion:vortex-compact 43431510 43556256 1.00
tpch_q09/datafusion:vortex-compact 56685517 57082162 0.99
tpch_q10/datafusion:vortex-compact 45288341 46568430 0.97
tpch_q11/datafusion:vortex-compact 17355505 17823895 0.97
tpch_q12/datafusion:vortex-compact 30382234 30967611 0.98
tpch_q13/datafusion:vortex-compact 32163401 32049953 1.00
tpch_q14/datafusion:vortex-compact 18975920 19315501 0.98
tpch_q15/datafusion:vortex-compact 31080698 31693808 0.98
tpch_q16/datafusion:vortex-compact 24841928 25861466 0.96
tpch_q17/datafusion:vortex-compact 72376387 70685285 1.02
tpch_q18/datafusion:vortex-compact 86748302 86395716 1.00
tpch_q19/datafusion:vortex-compact 30361918 31945590 0.95
tpch_q20/datafusion:vortex-compact 33379677 34114380 0.98
tpch_q21/datafusion:vortex-compact 76070741 77640535 0.98
tpch_q22/datafusion:vortex-compact 12700928 12603848 1.01
datafusion / parquet (0.991x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 118112142 111908088 1.06
tpch_q02/datafusion:parquet 61689029 62174209 0.99
tpch_q03/datafusion:parquet 72868817 68172212 1.07
tpch_q04/datafusion:parquet 42600444 43660033 0.98
tpch_q05/datafusion:parquet 94065257 93255283 1.01
tpch_q06/datafusion:parquet 39178647 42107624 0.93
tpch_q07/datafusion:parquet 107199188 106294667 1.01
tpch_q08/datafusion:parquet 91290375 99731587 0.92
tpch_q09/datafusion:parquet 128699472 129718421 0.99
tpch_q10/datafusion:parquet 112397420 113990117 0.99
tpch_q11/datafusion:parquet 42362945 42310591 1.00
tpch_q12/datafusion:parquet 86877747 87565715 0.99
tpch_q13/datafusion:parquet 203268537 205673661 0.99
tpch_q14/datafusion:parquet 44214075 41999175 1.05
tpch_q15/datafusion:parquet 58824527 59822548 0.98
tpch_q16/datafusion:parquet 41153591 41853315 0.98
tpch_q17/datafusion:parquet 132822383 129630349 1.02
tpch_q18/datafusion:parquet 164607777 166874138 0.99
tpch_q19/datafusion:parquet 72280889 77728341 0.93
tpch_q20/datafusion:parquet 69023380 71362351 0.97
tpch_q21/datafusion:parquet 139614559 135242718 1.03
tpch_q22/datafusion:parquet 31345375 33067497 0.95
datafusion / arrow (0.982x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52142828 57364476 0.91
tpch_q02/datafusion:arrow 18761095 19439549 0.97
tpch_q03/datafusion:arrow 29462731 30947861 0.95
tpch_q04/datafusion:arrow 26055684 26434495 0.99
tpch_q05/datafusion:arrow 80709679 76274842 1.06
tpch_q06/datafusion:arrow 21190110 19920651 1.06
tpch_q07/datafusion:arrow 103845866 104523251 0.99
tpch_q08/datafusion:arrow 43041923 43734321 0.98
tpch_q09/datafusion:arrow 65277430 66875558 0.98
tpch_q10/datafusion:arrow 45974575 50252731 0.91
tpch_q11/datafusion:arrow 9223527 9087116 1.02
tpch_q12/datafusion:arrow 50845467 51666808 0.98
tpch_q13/datafusion:arrow 46999774 47572340 0.99
tpch_q14/datafusion:arrow 21063148 22187510 0.95
tpch_q15/datafusion:arrow 43106671 44127846 0.98
tpch_q16/datafusion:arrow 19153852 19121190 1.00
tpch_q17/datafusion:arrow 67663705 69095256 0.98
tpch_q18/datafusion:arrow 135314797 138462999 0.98
tpch_q19/datafusion:arrow 34529305 35884282 0.96
tpch_q20/datafusion:arrow 33377367 34406480 0.97
tpch_q21/datafusion:arrow 152221954 148065738 1.03
tpch_q22/datafusion:arrow 17796692 17958210 0.99
duckdb / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31335749 31277685 1.00
tpch_q02/duckdb:vortex-file-compressed 25463016 24916717 1.02
tpch_q03/duckdb:vortex-file-compressed 32702069 33178134 0.99
tpch_q04/duckdb:vortex-file-compressed 28783859 28532535 1.01
tpch_q05/duckdb:vortex-file-compressed 37712298 37531547 1.00
tpch_q06/duckdb:vortex-file-compressed 8707439 8105677 1.07
tpch_q07/duckdb:vortex-file-compressed 35145222 35364305 0.99
tpch_q08/duckdb:vortex-file-compressed 37641569 37177147 1.01
tpch_q09/duckdb:vortex-file-compressed 58064371 58469623 0.99
tpch_q10/duckdb:vortex-file-compressed 41105964 40629557 1.01
tpch_q11/duckdb:vortex-file-compressed 15021661 15014051 1.00
tpch_q12/duckdb:vortex-file-compressed 22769814 22787856 1.00
tpch_q13/duckdb:vortex-file-compressed 42365384 42103082 1.01
tpch_q14/duckdb:vortex-file-compressed 23279386 22547334 1.03
tpch_q15/duckdb:vortex-file-compressed 17023079 17128851 0.99
tpch_q16/duckdb:vortex-file-compressed 30043457 29904909 1.00
tpch_q17/duckdb:vortex-file-compressed 24233877 24299920 1.00
tpch_q18/duckdb:vortex-file-compressed 53472910 53506957 1.00
tpch_q19/duckdb:vortex-file-compressed 28841846 29774838 0.97
tpch_q20/duckdb:vortex-file-compressed 33105531 33852000 0.98
tpch_q21/duckdb:vortex-file-compressed 100169696 102213780 0.98
tpch_q22/duckdb:vortex-file-compressed 17354128 18199783 0.95
duckdb / vortex-compact (0.999x ➖, 0↑ 1↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38815521 38375252 1.01
tpch_q02/duckdb:vortex-compact 34281231 33963288 1.01
tpch_q03/duckdb:vortex-compact 35296082 35055356 1.01
tpch_q04/duckdb:vortex-compact 31617372 31578476 1.00
tpch_q05/duckdb:vortex-compact 41981471 41557482 1.01
tpch_q06/duckdb:vortex-compact 🚨 11293315 10223943 1.10
tpch_q07/duckdb:vortex-compact 40501797 40702788 1.00
tpch_q08/duckdb:vortex-compact 41644037 42669489 0.98
tpch_q09/duckdb:vortex-compact 65759953 66435529 0.99
tpch_q10/duckdb:vortex-compact 45378946 44750253 1.01
tpch_q11/duckdb:vortex-compact 18404250 18629412 0.99
tpch_q12/duckdb:vortex-compact 29988288 29936022 1.00
tpch_q13/duckdb:vortex-compact 47692933 48441910 0.98
tpch_q14/duckdb:vortex-compact 27008699 26055308 1.04
tpch_q15/duckdb:vortex-compact 20347697 19970733 1.02
tpch_q16/duckdb:vortex-compact 31436569 33370673 0.94
tpch_q17/duckdb:vortex-compact 28559591 29016427 0.98
tpch_q18/duckdb:vortex-compact 53062425 53632302 0.99
tpch_q19/duckdb:vortex-compact 33893247 33446907 1.01
tpch_q20/duckdb:vortex-compact 39840792 41161945 0.97
tpch_q21/duckdb:vortex-compact 102235191 103628735 0.99
tpch_q22/duckdb:vortex-compact 18639236 19401523 0.96
duckdb / parquet (0.991x ➖, 2↑ 1↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79051586 79613051 0.99
tpch_q02/duckdb:parquet 39464321 39907996 0.99
tpch_q03/duckdb:parquet 70604042 70928205 1.00
tpch_q04/duckdb:parquet 🚀 49631453 55764897 0.89
tpch_q05/duckdb:parquet 67650020 70209055 0.96
tpch_q06/duckdb:parquet 22572626 22133218 1.02
tpch_q07/duckdb:parquet 🚨 83861180 69410809 1.21
tpch_q08/duckdb:parquet 82546406 82407563 1.00
tpch_q09/duckdb:parquet 🚀 140474481 156206363 0.90
tpch_q10/duckdb:parquet 126224939 133939629 0.94
tpch_q11/duckdb:parquet 22852651 22569474 1.01
tpch_q12/duckdb:parquet 46817665 46741950 1.00
tpch_q13/duckdb:parquet 253660722 255256850 0.99
tpch_q14/duckdb:parquet 50838696 51085276 1.00
tpch_q15/duckdb:parquet 25939908 26940436 0.96
tpch_q16/duckdb:parquet 58075545 58150232 1.00
tpch_q17/duckdb:parquet 57244086 59052898 0.97
tpch_q18/duckdb:parquet 119049193 121276618 0.98
tpch_q19/duckdb:parquet 70220966 69058470 1.02
tpch_q20/duckdb:parquet 65530156 65165477 1.01
tpch_q21/duckdb:parquet 175490587 174826887 1.00
tpch_q22/duckdb:parquet 53708966 54172708 0.99
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17653222 17888303 0.99
tpch_q02/duckdb:duckdb 14309316 14271472 1.00
tpch_q03/duckdb:duckdb 22544560 23242640 0.97
tpch_q04/duckdb:duckdb 22530168 21287976 1.06
tpch_q05/duckdb:duckdb 23587653 23521190 1.00
tpch_q06/duckdb:duckdb 6971217 7094123 0.98
tpch_q07/duckdb:duckdb 25544057 25549035 1.00
tpch_q08/duckdb:duckdb 24270507 24326540 1.00
tpch_q09/duckdb:duckdb 57900011 57040287 1.02
tpch_q10/duckdb:duckdb 49698591 51855164 0.96
tpch_q11/duckdb:duckdb 7331876 7246097 1.01
tpch_q12/duckdb:duckdb 18109348 17784641 1.02
tpch_q13/duckdb:duckdb 39715706 39602282 1.00
tpch_q14/duckdb:duckdb 21790515 21698012 1.00
tpch_q15/duckdb:duckdb 13725757 13609395 1.01
tpch_q16/duckdb:duckdb 26190904 26044978 1.01
tpch_q17/duckdb:duckdb 16008352 16227202 0.99
tpch_q18/duckdb:duckdb 41369512 40618407 1.02
tpch_q19/duckdb:duckdb 30742864 31170707 0.99
tpch_q20/duckdb:duckdb 25190167 25271874 1.00
tpch_q21/duckdb:duckdb 61275374 61963482 0.99
tpch_q22/duckdb:duckdb 25730537 25553714 1.01
File Size Changes (10 files changed, -0.1% overall, 5↑ 5↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 1.0 vortex-file-compressed 605.52 KB 622.80 KB +17.28 KB +2.9%
part_0.vortex 1.0 vortex-file-compressed 4.94 MB 4.98 MB +45.09 KB +0.9%
part_0.vortex 1.0 vortex-compact 3.35 MB 3.38 MB +27.77 KB +0.8%
lineitem_1.vortex 1.0 vortex-file-compressed 84.51 MB 84.63 MB +125.38 KB +0.1%
orders_0.vortex 1.0 vortex-file-compressed 38.62 MB 38.67 MB +54.44 KB +0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.16 MB 85.16 MB 2.91 KB -0.0%
customer_0.vortex 1.0 vortex-file-compressed 8.91 MB 8.90 MB 10.62 KB -0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.83 MB 23.79 MB 35.80 KB -0.1%
partsupp_0.vortex 1.0 vortex-compact 20.92 MB 20.70 MB 226.04 KB -1.1%
orders_0.vortex 1.0 vortex-compact 32.20 MB 31.73 MB 482.27 KB -1.5%

Totals:

  • vortex-compact: 190.69 MB → 190.03 MB (-0.3%)
  • vortex-file-compressed: 246.84 MB → 247.02 MB (+0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -9.1% +2.4% -11.2% +21.1% ➖ noise
1 datafusion:vortex-compact +0.8% +2.4% -1.5% +18.6% ➖ noise
1 datafusion:vortex-file-compressed -4.6% +2.4% -6.8% +19.9% ➖ noise
1 duckdb:duckdb -1.3% +2.4% -3.6% +17.6% ➖ noise
1 duckdb:vortex-compact +1.1% +2.4% -1.2% +17.8% ➖ noise
1 duckdb:vortex-file-compressed +0.2% +2.4% -2.1% +19.9% ➖ noise
2 datafusion:arrow -3.5% -0.9% -2.6% +10.0% ➖ noise
2 datafusion:vortex-compact -2.7% -0.9% -1.8% +12.4% ➖ noise
2 datafusion:vortex-file-compressed -1.9% -0.9% -1.0% +10.8% ➖ noise
2 duckdb:duckdb +0.3% -0.9% +1.2% +10.0% ➖ noise
2 duckdb:vortex-compact +0.9% -0.9% +1.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.2% -0.9% +3.2% +10.0% ➖ noise
3 datafusion:arrow -4.8% +3.2% -7.7% +10.2% ➖ noise
3 datafusion:vortex-compact -2.1% +3.2% -5.1% +11.6% ➖ noise
3 datafusion:vortex-file-compressed -0.5% +3.2% -3.5% +14.1% ➖ noise
3 duckdb:duckdb -3.0% +3.2% -6.0% +10.0% ➖ noise
3 duckdb:vortex-compact +0.7% +3.2% -2.4% +11.1% ➖ noise
3 duckdb:vortex-file-compressed -1.4% +3.2% -4.4% +10.0% ➖ noise
4 datafusion:arrow -1.4% -6.8% +5.8% +10.0% ➖ noise
4 datafusion:vortex-compact +1.5% -6.8% +8.9% +11.3% ➖ noise
4 datafusion:vortex-file-compressed -1.4% -6.8% +5.8% +12.4% ➖ noise
4 duckdb:duckdb +5.8% -6.8% +13.6% +10.0% 🚨 regression
4 duckdb:vortex-compact +0.1% -6.8% +7.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.9% -6.8% +8.3% +10.0% ➖ noise
5 datafusion:arrow +5.8% -1.4% +7.3% +10.0% ➖ noise
5 datafusion:vortex-compact -2.0% -1.4% -0.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.8% -1.4% -0.3% +10.0% ➖ noise
5 duckdb:duckdb +0.3% -1.4% +1.7% +10.0% ➖ noise
5 duckdb:vortex-compact +1.0% -1.4% +2.5% +11.7% ➖ noise
5 duckdb:vortex-file-compressed +0.5% -1.4% +1.9% +11.9% ➖ noise
6 datafusion:arrow +6.4% -2.6% +9.2% +12.1% ➖ noise
6 datafusion:vortex-compact -3.2% -2.6% -0.7% +18.3% ➖ noise
6 datafusion:vortex-file-compressed +4.4% -2.6% +7.2% +12.9% ➖ noise
6 duckdb:duckdb -1.7% -2.6% +0.9% +11.4% ➖ noise
6 duckdb:vortex-compact +10.5% -2.6% +13.4% +13.9% ➖ noise
6 duckdb:vortex-file-compressed +7.4% -2.6% +10.3% +14.0% ➖ noise
7 datafusion:arrow -0.6% +10.4% -10.0% +11.2% ➖ noise
7 datafusion:vortex-compact -1.2% +10.4% -10.5% +10.0% ✅ faster
7 datafusion:vortex-file-compressed +0.1% +10.4% -9.3% +10.0% ✅ faster
7 duckdb:duckdb -0.0% +10.4% -9.4% +10.0% ✅ faster
7 duckdb:vortex-compact -0.5% +10.4% -9.9% +10.0% ✅ faster
7 duckdb:vortex-file-compressed -0.6% +10.4% -10.0% +10.0% ✅ faster
8 datafusion:arrow -1.6% -4.2% +2.8% +10.6% ➖ noise
8 datafusion:vortex-compact -0.3% -4.2% +4.1% +14.1% ➖ noise
8 datafusion:vortex-file-compressed -0.6% -4.2% +3.8% +10.0% ➖ noise
8 duckdb:duckdb -0.2% -4.2% +4.2% +10.8% ➖ noise
8 duckdb:vortex-compact -2.4% -4.2% +1.9% +13.0% ➖ noise
8 duckdb:vortex-file-compressed +1.2% -4.2% +5.7% +13.0% ➖ noise
9 datafusion:arrow -2.4% -5.5% +3.3% +10.0% ➖ noise
9 datafusion:vortex-compact -0.7% -5.5% +5.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.9% -5.5% +7.9% +10.0% ➖ noise
9 duckdb:duckdb +1.5% -5.5% +7.5% +10.0% ➖ noise
9 duckdb:vortex-compact -1.0% -5.5% +4.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.7% -5.5% +5.1% +10.0% ➖ noise
10 datafusion:arrow -8.5% -3.6% -5.1% +10.0% ➖ noise
10 datafusion:vortex-compact -2.7% -3.6% +0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.8% -3.6% +3.0% +10.0% ➖ noise
10 duckdb:duckdb -4.2% -3.6% -0.6% +10.0% ➖ noise
10 duckdb:vortex-compact +1.4% -3.6% +5.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.2% -3.6% +5.0% +10.0% ➖ noise
11 datafusion:arrow +1.5% +0.7% +0.8% +10.0% ➖ noise
11 datafusion:vortex-compact -2.6% +0.7% -3.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.2% +0.7% -2.9% +12.5% ➖ noise
11 duckdb:duckdb +1.2% +0.7% +0.5% +10.0% ➖ noise
11 duckdb:vortex-compact -1.2% +0.7% -1.9% +25.0% ➖ noise
11 duckdb:vortex-file-compressed +0.1% +0.7% -0.6% +15.6% ➖ noise
12 datafusion:arrow -1.6% -0.3% -1.3% +17.8% ➖ noise
12 datafusion:vortex-compact -1.9% -0.3% -1.6% +11.3% ➖ noise
12 datafusion:vortex-file-compressed +0.8% -0.3% +1.1% +12.2% ➖ noise
12 duckdb:duckdb +1.8% -0.3% +2.1% +10.0% ➖ noise
12 duckdb:vortex-compact +0.2% -0.3% +0.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.1% -0.3% +0.2% +11.9% ➖ noise
13 datafusion:arrow -1.2% -0.9% -0.3% +11.0% ➖ noise
13 datafusion:vortex-compact +0.4% -0.9% +1.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.6% -0.9% +2.5% +10.0% ➖ noise
13 duckdb:duckdb +0.3% -0.9% +1.2% +10.0% ➖ noise
13 duckdb:vortex-compact -1.5% -0.9% -0.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.6% -0.9% +1.5% +10.0% ➖ noise
14 datafusion:arrow -5.1% +2.4% -7.3% +12.3% ➖ noise
14 datafusion:vortex-compact -1.8% +2.4% -4.0% +13.4% ➖ noise
14 datafusion:vortex-file-compressed -3.2% +2.4% -5.4% +11.4% ➖ noise
14 duckdb:duckdb +0.4% +2.4% -1.9% +10.0% ➖ noise
14 duckdb:vortex-compact +3.7% +2.4% +1.3% +11.2% ➖ noise
14 duckdb:vortex-file-compressed +3.2% +2.4% +0.9% +11.2% ➖ noise
15 datafusion:arrow -2.3% -2.7% +0.4% +11.7% ➖ noise
15 datafusion:vortex-compact -1.9% -2.7% +0.8% +11.7% ➖ noise
15 datafusion:vortex-file-compressed -1.7% -2.7% +1.0% +13.5% ➖ noise
15 duckdb:duckdb +0.9% -2.7% +3.6% +10.4% ➖ noise
15 duckdb:vortex-compact +1.9% -2.7% +4.7% +15.0% ➖ noise
15 duckdb:vortex-file-compressed -0.6% -2.7% +2.1% +10.7% ➖ noise
16 datafusion:arrow +0.2% -0.9% +1.1% +10.0% ➖ noise
16 datafusion:vortex-compact -3.9% -0.9% -3.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.3% -0.9% +2.2% +10.0% ➖ noise
16 duckdb:duckdb +0.6% -0.9% +1.5% +10.0% ➖ noise
16 duckdb:vortex-compact -5.8% -0.9% -4.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.5% -0.9% +1.4% +10.0% ➖ noise
17 datafusion:arrow -2.1% -0.3% -1.7% +11.3% ➖ noise
17 datafusion:vortex-compact +2.4% -0.3% +2.7% +12.7% ➖ noise
17 datafusion:vortex-file-compressed -1.4% -0.3% -1.0% +13.7% ➖ noise
17 duckdb:duckdb -1.3% -0.3% -1.0% +10.0% ➖ noise
17 duckdb:vortex-compact -1.6% -0.3% -1.2% +12.2% ➖ noise
17 duckdb:vortex-file-compressed -0.3% -0.3% +0.1% +12.3% ➖ noise
18 datafusion:arrow -2.3% -1.6% -0.7% +10.0% ➖ noise
18 datafusion:vortex-compact +0.4% -1.6% +2.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.3% -1.6% +2.9% +10.0% ➖ noise
18 duckdb:duckdb +1.8% -1.6% +3.5% +10.0% ➖ noise
18 duckdb:vortex-compact -1.1% -1.6% +0.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.1% -1.6% +1.6% +10.0% ➖ noise
19 datafusion:arrow -3.8% -2.8% -1.0% +13.9% ➖ noise
19 datafusion:vortex-compact -5.0% -2.8% -2.3% +17.0% ➖ noise
19 datafusion:vortex-file-compressed -3.0% -2.8% -0.2% +16.7% ➖ noise
19 duckdb:duckdb -1.4% -2.8% +1.4% +13.3% ➖ noise
19 duckdb:vortex-compact +1.3% -2.8% +4.2% +14.8% ➖ noise
19 duckdb:vortex-file-compressed -3.1% -2.8% -0.4% +14.9% ➖ noise
20 datafusion:arrow -3.0% -1.4% -1.6% +10.0% ➖ noise
20 datafusion:vortex-compact -2.2% -1.4% -0.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.5% -1.4% +4.9% +11.3% ➖ noise
20 duckdb:duckdb -0.3% -1.4% +1.1% +10.0% ➖ noise
20 duckdb:vortex-compact -3.2% -1.4% -1.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -2.2% -1.4% -0.8% +11.1% ➖ noise
21 datafusion:arrow +2.8% +1.8% +1.0% +10.0% ➖ noise
21 datafusion:vortex-compact -2.0% +1.8% -3.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -2.4% +1.8% -4.2% +10.0% ➖ noise
21 duckdb:duckdb -1.1% +1.8% -2.9% +10.0% ➖ noise
21 duckdb:vortex-compact -1.3% +1.8% -3.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -2.0% +1.8% -3.7% +10.0% ➖ noise
22 datafusion:arrow -0.9% -3.1% +2.2% +10.0% ➖ noise
22 datafusion:vortex-compact +0.8% -3.1% +3.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.9% -3.1% +1.2% +10.0% ➖ noise
22 duckdb:duckdb +0.7% -3.1% +3.9% +10.0% ➖ noise
22 duckdb:vortex-compact -3.9% -3.1% -0.9% +15.6% ➖ noise
22 duckdb:vortex-file-compressed -4.6% -3.1% -1.6% +10.0% ➖ noise

@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): 0.977x ➖
Parquet (geomean): 0.985x ➖
Shifts: Parquet (control) -1.5% · Median polish -1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.976x ➖, 2↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27120072 28288092 0.96
tpcds_q02/datafusion:vortex-file-compressed 48592435 50113532 0.97
tpcds_q03/datafusion:vortex-file-compressed 15526614 16222094 0.96
tpcds_q04/datafusion:vortex-file-compressed 268085532 281021811 0.95
tpcds_q05/datafusion:vortex-file-compressed 45572459 48137767 0.95
tpcds_q06/datafusion:vortex-file-compressed 63001166 63860558 0.99
tpcds_q07/datafusion:vortex-file-compressed 44168722 46331784 0.95
tpcds_q08/datafusion:vortex-file-compressed 29932240 31281052 0.96
tpcds_q09/datafusion:vortex-file-compressed 39689376 41047159 0.97
tpcds_q10/datafusion:vortex-file-compressed 38209112 40614399 0.94
tpcds_q11/datafusion:vortex-file-compressed 134660993 138324468 0.97
tpcds_q12/datafusion:vortex-file-compressed 20411040 20693003 0.99
tpcds_q13/datafusion:vortex-file-compressed 49200086 49820260 0.99
tpcds_q14/datafusion:vortex-file-compressed 172460842 182391242 0.95
tpcds_q15/datafusion:vortex-file-compressed 30837687 30416892 1.01
tpcds_q16/datafusion:vortex-file-compressed 29546208 30220877 0.98
tpcds_q17/datafusion:vortex-file-compressed 67160505 66163445 1.02
tpcds_q18/datafusion:vortex-file-compressed 70142086 73290029 0.96
tpcds_q19/datafusion:vortex-file-compressed 24754462 22991414 1.08
tpcds_q20/datafusion:vortex-file-compressed 21873772 23621999 0.93
tpcds_q21/datafusion:vortex-file-compressed 35060573 37212732 0.94
tpcds_q22/datafusion:vortex-file-compressed 127283153 116785755 1.09
tpcds_q23/datafusion:vortex-file-compressed 155205304 157594336 0.98
tpcds_q24/datafusion:vortex-file-compressed 90049865 90637582 0.99
tpcds_q25/datafusion:vortex-file-compressed 69037584 71214661 0.97
tpcds_q26/datafusion:vortex-file-compressed 34664776 35227925 0.98
tpcds_q27/datafusion:vortex-file-compressed 107182864 107764825 0.99
tpcds_q28/datafusion:vortex-file-compressed 34174441 34306303 1.00
tpcds_q29/datafusion:vortex-file-compressed 63417885 65850772 0.96
tpcds_q30/datafusion:vortex-file-compressed 23659996 25229550 0.94
tpcds_q31/datafusion:vortex-file-compressed 76421230 79985929 0.96
tpcds_q32/datafusion:vortex-file-compressed 20933207 20856753 1.00
tpcds_q33/datafusion:vortex-file-compressed 30579176 32103546 0.95
tpcds_q34/datafusion:vortex-file-compressed 24953394 27125196 0.92
tpcds_q35/datafusion:vortex-file-compressed 46556112 47920717 0.97
tpcds_q36/datafusion:vortex-file-compressed 59413355 61580275 0.96
tpcds_q37/datafusion:vortex-file-compressed 24966515 25625928 0.97
tpcds_q38/datafusion:vortex-file-compressed 46080500 47070365 0.98
tpcds_q39/datafusion:vortex-file-compressed 110499093 115350387 0.96
tpcds_q40/datafusion:vortex-file-compressed 33445933 35450808 0.94
tpcds_q41/datafusion:vortex-file-compressed 16463862 17305820 0.95
tpcds_q42/datafusion:vortex-file-compressed 14422495 14736988 0.98
tpcds_q43/datafusion:vortex-file-compressed 18834824 19577428 0.96
tpcds_q44/datafusion:vortex-file-compressed 32409994 33524184 0.97
tpcds_q45/datafusion:vortex-file-compressed 29144048 29281571 1.00
tpcds_q46/datafusion:vortex-file-compressed 36392337 36894450 0.99
tpcds_q47/datafusion:vortex-file-compressed 135093934 139442125 0.97
tpcds_q48/datafusion:vortex-file-compressed 37579403 37314776 1.01
tpcds_q49/datafusion:vortex-file-compressed 60923944 60555258 1.01
tpcds_q50/datafusion:vortex-file-compressed 41190635 40721165 1.01
tpcds_q51/datafusion:vortex-file-compressed 92792937 93704883 0.99
tpcds_q52/datafusion:vortex-file-compressed 16880767 15603365 1.08
tpcds_q53/datafusion:vortex-file-compressed 22470863 23624843 0.95
tpcds_q54/datafusion:vortex-file-compressed 35992365 37818610 0.95
tpcds_q55/datafusion:vortex-file-compressed 14369694 14874246 0.97
tpcds_q56/datafusion:vortex-file-compressed 31132128 33023747 0.94
tpcds_q57/datafusion:vortex-file-compressed 115627205 114328175 1.01
tpcds_q58/datafusion:vortex-file-compressed 53729583 57473448 0.93
tpcds_q59/datafusion:vortex-file-compressed 57131229 60351434 0.95
tpcds_q60/datafusion:vortex-file-compressed 31686530 31973695 0.99
tpcds_q61/datafusion:vortex-file-compressed 41800373 42641243 0.98
tpcds_q62/datafusion:vortex-file-compressed 🚀 24686149 28253982 0.87
tpcds_q63/datafusion:vortex-file-compressed 22724158 23233952 0.98
tpcds_q64/datafusion:vortex-file-compressed 426855520 441220361 0.97
tpcds_q65/datafusion:vortex-file-compressed 40848894 41712003 0.98
tpcds_q66/datafusion:vortex-file-compressed 74503500 78431749 0.95
tpcds_q67/datafusion:vortex-file-compressed 147028513 148800903 0.99
tpcds_q68/datafusion:vortex-file-compressed 34150163 34581219 0.99
tpcds_q69/datafusion:vortex-file-compressed 36090448 38857056 0.93
tpcds_q70/datafusion:vortex-file-compressed 85368798 89778082 0.95
tpcds_q71/datafusion:vortex-file-compressed 23703318 24226324 0.98
tpcds_q72/datafusion:vortex-file-compressed 2236416801 2273719851 0.98
tpcds_q73/datafusion:vortex-file-compressed 24119414 24544437 0.98
tpcds_q74/datafusion:vortex-file-compressed 83376231 85491441 0.98
tpcds_q75/datafusion:vortex-file-compressed 116197068 114651234 1.01
tpcds_q76/datafusion:vortex-file-compressed 32596053 31208555 1.04
tpcds_q77/datafusion:vortex-file-compressed 40528600 43975056 0.92
tpcds_q78/datafusion:vortex-file-compressed 133661890 132471157 1.01
tpcds_q79/datafusion:vortex-file-compressed 28968184 30041730 0.96
tpcds_q80/datafusion:vortex-file-compressed 95675361 99715803 0.96
tpcds_q81/datafusion:vortex-file-compressed 25972615 25586213 1.02
tpcds_q82/datafusion:vortex-file-compressed 25950091 27863488 0.93
tpcds_q83/datafusion:vortex-file-compressed 35792561 36242430 0.99
tpcds_q84/datafusion:vortex-file-compressed 13511704 14302261 0.94
tpcds_q85/datafusion:vortex-file-compressed 93977379 94898325 0.99
tpcds_q86/datafusion:vortex-file-compressed 17488225 16635114 1.05
tpcds_q87/datafusion:vortex-file-compressed 46425807 48122121 0.96
tpcds_q88/datafusion:vortex-file-compressed 57121791 57952781 0.99
tpcds_q89/datafusion:vortex-file-compressed 25811885 27773204 0.93
tpcds_q90/datafusion:vortex-file-compressed 16464365 15890690 1.04
tpcds_q91/datafusion:vortex-file-compressed 20888809 19872437 1.05
tpcds_q92/datafusion:vortex-file-compressed 19633200 19532978 1.01
tpcds_q93/datafusion:vortex-file-compressed 34366975 35524386 0.97
tpcds_q94/datafusion:vortex-file-compressed 25178622 24958174 1.01
tpcds_q95/datafusion:vortex-file-compressed 62255846 65632634 0.95
tpcds_q96/datafusion:vortex-file-compressed 🚀 13680674 15295474 0.89
tpcds_q97/datafusion:vortex-file-compressed 33665125 32677983 1.03
tpcds_q98/datafusion:vortex-file-compressed 24479429 24845496 0.99
tpcds_q99/datafusion:vortex-file-compressed 32961938 33695756 0.98
datafusion / vortex-compact (0.984x ➖, 2↑ 4↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27029660 28058325 0.96
tpcds_q02/datafusion:vortex-compact 55061365 55486832 0.99
tpcds_q03/datafusion:vortex-compact 20221979 20487642 0.99
tpcds_q04/datafusion:vortex-compact 304904052 313216868 0.97
tpcds_q05/datafusion:vortex-compact 48432277 50695435 0.96
tpcds_q06/datafusion:vortex-compact 66280439 61120531 1.08
tpcds_q07/datafusion:vortex-compact 56329391 55871520 1.01
tpcds_q08/datafusion:vortex-compact 36636998 36992066 0.99
tpcds_q09/datafusion:vortex-compact 51948146 53797847 0.97
tpcds_q10/datafusion:vortex-compact 51022569 50851493 1.00
tpcds_q11/datafusion:vortex-compact 155331246 162702629 0.95
tpcds_q12/datafusion:vortex-compact 🚨 27890825 24124392 1.16
tpcds_q13/datafusion:vortex-compact 132305795 146336136 0.90
tpcds_q14/datafusion:vortex-compact 203812500 215048880 0.95
tpcds_q15/datafusion:vortex-compact 31899900 32300512 0.99
tpcds_q16/datafusion:vortex-compact 34920182 34036204 1.03
tpcds_q17/datafusion:vortex-compact 76655819 81158308 0.94
tpcds_q18/datafusion:vortex-compact 79667157 84234772 0.95
tpcds_q19/datafusion:vortex-compact 33020898 30970143 1.07
tpcds_q20/datafusion:vortex-compact 27100192 27486947 0.99
tpcds_q21/datafusion:vortex-compact 40552422 42909783 0.95
tpcds_q22/datafusion:vortex-compact 124474089 129989329 0.96
tpcds_q23/datafusion:vortex-compact 169656956 171723656 0.99
tpcds_q24/datafusion:vortex-compact 101427987 103765808 0.98
tpcds_q25/datafusion:vortex-compact 82310813 86909828 0.95
tpcds_q26/datafusion:vortex-compact 48851843 45702313 1.07
tpcds_q27/datafusion:vortex-compact 129409920 131940541 0.98
tpcds_q28/datafusion:vortex-compact 106170186 105573933 1.01
tpcds_q29/datafusion:vortex-compact 76378870 78444706 0.97
tpcds_q30/datafusion:vortex-compact 28535025 29876226 0.96
tpcds_q31/datafusion:vortex-compact 98506060 102054530 0.97
tpcds_q32/datafusion:vortex-compact 25701927 28374099 0.91
tpcds_q33/datafusion:vortex-compact 37397659 37609666 0.99
tpcds_q34/datafusion:vortex-compact 34219961 34826655 0.98
tpcds_q35/datafusion:vortex-compact 54249357 53553589 1.01
tpcds_q36/datafusion:vortex-compact 75699222 79139377 0.96
tpcds_q37/datafusion:vortex-compact 36232711 37688829 0.96
tpcds_q38/datafusion:vortex-compact 55968210 53365186 1.05
tpcds_q39/datafusion:vortex-compact 115093924 121665219 0.95
tpcds_q40/datafusion:vortex-compact 37571324 38378317 0.98
tpcds_q41/datafusion:vortex-compact 18691816 19359642 0.97
tpcds_q42/datafusion:vortex-compact 18847829 19437830 0.97
tpcds_q43/datafusion:vortex-compact 26358631 27837362 0.95
tpcds_q44/datafusion:vortex-compact 48899743 50120079 0.98
tpcds_q45/datafusion:vortex-compact 32099532 32507038 0.99
tpcds_q46/datafusion:vortex-compact 45702033 46537802 0.98
tpcds_q47/datafusion:vortex-compact 155599012 159318467 0.98
tpcds_q48/datafusion:vortex-compact 🚨 103249125 84792888 1.22
tpcds_q49/datafusion:vortex-compact 72354619 75761670 0.96
tpcds_q50/datafusion:vortex-compact 49119927 49423929 0.99
tpcds_q51/datafusion:vortex-compact 99419652 99814292 1.00
tpcds_q52/datafusion:vortex-compact 19107260 19152053 1.00
tpcds_q53/datafusion:vortex-compact 29179366 29843677 0.98
tpcds_q54/datafusion:vortex-compact 44371138 45088570 0.98
tpcds_q55/datafusion:vortex-compact 18403065 18630348 0.99
tpcds_q56/datafusion:vortex-compact 37677169 37690763 1.00
tpcds_q57/datafusion:vortex-compact 120969596 123889572 0.98
tpcds_q58/datafusion:vortex-compact 63984979 63614812 1.01
tpcds_q59/datafusion:vortex-compact 70576051 74893378 0.94
tpcds_q60/datafusion:vortex-compact 37232952 37535662 0.99
tpcds_q61/datafusion:vortex-compact 55709522 55970915 1.00
tpcds_q62/datafusion:vortex-compact 🚨 33848257 25385700 1.33
tpcds_q63/datafusion:vortex-compact 29798444 30308371 0.98
tpcds_q64/datafusion:vortex-compact 471175112 477746360 0.99
tpcds_q65/datafusion:vortex-compact 53745221 54336087 0.99
tpcds_q66/datafusion:vortex-compact 80180775 81516377 0.98
tpcds_q67/datafusion:vortex-compact 159130362 151410204 1.05
tpcds_q68/datafusion:vortex-compact 47404153 46950030 1.01
tpcds_q69/datafusion:vortex-compact 47491099 50598812 0.94
tpcds_q70/datafusion:vortex-compact 99928157 97796534 1.02
tpcds_q71/datafusion:vortex-compact 30042768 31887998 0.94
tpcds_q72/datafusion:vortex-compact 2264385095 2272275493 1.00
tpcds_q73/datafusion:vortex-compact 31382915 31482691 1.00
tpcds_q74/datafusion:vortex-compact 96553465 103130282 0.94
tpcds_q75/datafusion:vortex-compact 130276221 136651199 0.95
tpcds_q76/datafusion:vortex-compact 34697086 34650943 1.00
tpcds_q77/datafusion:vortex-compact 52408336 54219887 0.97
tpcds_q78/datafusion:vortex-compact 138933548 145552992 0.95
tpcds_q79/datafusion:vortex-compact 38561061 39246100 0.98
tpcds_q80/datafusion:vortex-compact 105879994 112341058 0.94
tpcds_q81/datafusion:vortex-compact 🚀 28311075 32027674 0.88
tpcds_q82/datafusion:vortex-compact 36787536 36909536 1.00
tpcds_q83/datafusion:vortex-compact 34236385 35320208 0.97
tpcds_q84/datafusion:vortex-compact 15007028 15873675 0.95
tpcds_q85/datafusion:vortex-compact 164673757 170418567 0.97
tpcds_q86/datafusion:vortex-compact 🚨 22341752 19065185 1.17
tpcds_q87/datafusion:vortex-compact 52017767 54891480 0.95
tpcds_q88/datafusion:vortex-compact 82746775 83643273 0.99
tpcds_q89/datafusion:vortex-compact 33241900 32825682 1.01
tpcds_q90/datafusion:vortex-compact 16265797 16320158 1.00
tpcds_q91/datafusion:vortex-compact 32010182 35566854 0.90
tpcds_q92/datafusion:vortex-compact 🚀 22426010 25949569 0.86
tpcds_q93/datafusion:vortex-compact 40064985 42115925 0.95
tpcds_q94/datafusion:vortex-compact 29878179 31950301 0.94
tpcds_q95/datafusion:vortex-compact 70440310 71548002 0.98
tpcds_q96/datafusion:vortex-compact 17551705 18276117 0.96
tpcds_q97/datafusion:vortex-compact 37596148 37835275 0.99
tpcds_q98/datafusion:vortex-compact 30922014 31689236 0.98
tpcds_q99/datafusion:vortex-compact 35317524 36598670 0.96
datafusion / parquet (0.984x ➖, 3↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 31734330 32709140 0.97
tpcds_q02/datafusion:parquet 42189664 45319922 0.93
tpcds_q03/datafusion:parquet 13005259 13304821 0.98
tpcds_q04/datafusion:parquet 275783570 275028455 1.00
tpcds_q05/datafusion:parquet 42296795 44657828 0.95
tpcds_q06/datafusion:parquet 59336676 59273838 1.00
tpcds_q07/datafusion:parquet 78120413 79123431 0.99
tpcds_q08/datafusion:parquet 27281135 28220993 0.97
tpcds_q09/datafusion:parquet 45994520 45673036 1.01
tpcds_q10/datafusion:parquet 71827247 72459347 0.99
tpcds_q11/datafusion:parquet 150832553 157481766 0.96
tpcds_q12/datafusion:parquet 18869496 19108531 0.99
tpcds_q13/datafusion:parquet 77840553 79494268 0.98
tpcds_q14/datafusion:parquet 166564429 167834832 0.99
tpcds_q15/datafusion:parquet 21312086 23466402 0.91
tpcds_q16/datafusion:parquet 🚀 23152480 28054141 0.83
tpcds_q17/datafusion:parquet 63911996 67403280 0.95
tpcds_q18/datafusion:parquet 115349514 125081276 0.92
tpcds_q19/datafusion:parquet 23408160 23801849 0.98
tpcds_q20/datafusion:parquet 17217328 17544809 0.98
tpcds_q21/datafusion:parquet 19311497 20113955 0.96
tpcds_q22/datafusion:parquet 157976827 171292040 0.92
tpcds_q23/datafusion:parquet 148465624 155629134 0.95
tpcds_q24/datafusion:parquet 92823000 95079429 0.98
tpcds_q25/datafusion:parquet 67969611 66417976 1.02
tpcds_q26/datafusion:parquet 67256980 67849917 0.99
tpcds_q27/datafusion:parquet 153058029 154588657 0.99
tpcds_q28/datafusion:parquet 44694019 45891891 0.97
tpcds_q29/datafusion:parquet 67136821 68218758 0.98
tpcds_q30/datafusion:parquet 35541371 37084279 0.96
tpcds_q31/datafusion:parquet 67258277 68734584 0.98
tpcds_q32/datafusion:parquet 18675000 19343584 0.97
tpcds_q33/datafusion:parquet 27608952 28144686 0.98
tpcds_q34/datafusion:parquet 22221837 22501469 0.99
tpcds_q35/datafusion:parquet 71613692 72264717 0.99
tpcds_q36/datafusion:parquet 59230091 59603134 0.99
tpcds_q37/datafusion:parquet 19800442 19599902 1.01
tpcds_q38/datafusion:parquet 41438425 44582045 0.93
tpcds_q39/datafusion:parquet 80015648 79997856 1.00
tpcds_q40/datafusion:parquet 26013209 25164610 1.03
tpcds_q41/datafusion:parquet 14477727 14926094 0.97
tpcds_q42/datafusion:parquet 12755185 11998335 1.06
tpcds_q43/datafusion:parquet 17607292 17836568 0.99
tpcds_q44/datafusion:parquet 34990922 36094490 0.97
tpcds_q45/datafusion:parquet 30043062 29722445 1.01
tpcds_q46/datafusion:parquet 33981513 34176325 0.99
tpcds_q47/datafusion:parquet 136616092 133149373 1.03
tpcds_q48/datafusion:parquet 73521614 72969874 1.01
tpcds_q49/datafusion:parquet 60668481 59244299 1.02
tpcds_q50/datafusion:parquet 47702705 46717629 1.02
tpcds_q51/datafusion:parquet 90700184 86630259 1.05
tpcds_q52/datafusion:parquet 12597034 12435852 1.01
tpcds_q53/datafusion:parquet 18827529 18240904 1.03
tpcds_q54/datafusion:parquet 35932619 37575590 0.96
tpcds_q55/datafusion:parquet 11737339 12170188 0.96
tpcds_q56/datafusion:parquet 28088208 29604752 0.95
tpcds_q57/datafusion:parquet 99248855 102148580 0.97
tpcds_q58/datafusion:parquet 53484459 51572582 1.04
tpcds_q59/datafusion:parquet 59050092 61156388 0.97
tpcds_q60/datafusion:parquet 28608556 28140288 1.02
tpcds_q61/datafusion:parquet 44375849 46423575 0.96
tpcds_q62/datafusion:parquet 🚀 22230175 25267955 0.88
tpcds_q63/datafusion:parquet 17974233 18129753 0.99
tpcds_q64/datafusion:parquet 541517546 538256406 1.01
tpcds_q65/datafusion:parquet 39203684 40270703 0.97
tpcds_q66/datafusion:parquet 73558696 69725605 1.05
tpcds_q67/datafusion:parquet 147817605 151850214 0.97
tpcds_q68/datafusion:parquet 32631230 32662613 1.00
tpcds_q69/datafusion:parquet 74802239 69442739 1.08
tpcds_q70/datafusion:parquet 86414546 91390042 0.95
tpcds_q71/datafusion:parquet 23240044 23787467 0.98
tpcds_q72/datafusion:parquet 643734456 644706014 1.00
tpcds_q73/datafusion:parquet 22137386 20988740 1.05
tpcds_q74/datafusion:parquet 86078848 87518227 0.98
tpcds_q75/datafusion:parquet 105140030 108679547 0.97
tpcds_q76/datafusion:parquet 31772734 30737163 1.03
tpcds_q77/datafusion:parquet 41842278 42288054 0.99
tpcds_q78/datafusion:parquet 121993936 123339081 0.99
tpcds_q79/datafusion:parquet 27425868 28344220 0.97
tpcds_q80/datafusion:parquet 80619293 86131581 0.94
tpcds_q81/datafusion:parquet 32045003 33487481 0.96
tpcds_q82/datafusion:parquet 19304279 19967348 0.97
tpcds_q83/datafusion:parquet 40237136 38571746 1.04
tpcds_q84/datafusion:parquet 40438888 41200568 0.98
tpcds_q85/datafusion:parquet 154561550 155344233 0.99
tpcds_q86/datafusion:parquet 16749671 16431876 1.02
tpcds_q87/datafusion:parquet 42791490 44240105 0.97
tpcds_q88/datafusion:parquet 61037612 60534730 1.01
tpcds_q89/datafusion:parquet 23203672 21771520 1.07
tpcds_q90/datafusion:parquet 14796227 15479405 0.96
tpcds_q91/datafusion:parquet 62392790 59671759 1.05
tpcds_q92/datafusion:parquet 18876944 18440002 1.02
tpcds_q93/datafusion:parquet 32547148 33098557 0.98
tpcds_q94/datafusion:parquet 20547539 20181653 1.02
tpcds_q95/datafusion:parquet 61619393 61500474 1.00
tpcds_q96/datafusion:parquet 12866347 12747408 1.01
tpcds_q97/datafusion:parquet 31243137 32333006 0.97
tpcds_q98/datafusion:parquet 22712668 23291827 0.98
tpcds_q99/datafusion:parquet 🚀 26604052 31214175 0.85
duckdb / vortex-file-compressed (0.974x ➖, 3↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24766325 25533160 0.97
tpcds_q02/duckdb:vortex-file-compressed 36370233 36846924 0.99
tpcds_q03/duckdb:vortex-file-compressed 22760183 22788308 1.00
tpcds_q04/duckdb:vortex-file-compressed 100264902 97207615 1.03
tpcds_q05/duckdb:vortex-file-compressed 33188066 36111924 0.92
tpcds_q06/duckdb:vortex-file-compressed 33009002 34955705 0.94
tpcds_q07/duckdb:vortex-file-compressed 21564603 22428134 0.96
tpcds_q08/duckdb:vortex-file-compressed 28272134 30408370 0.93
tpcds_q09/duckdb:vortex-file-compressed 16063508 16340042 0.98
tpcds_q10/duckdb:vortex-file-compressed 38408578 38732268 0.99
tpcds_q11/duckdb:vortex-file-compressed 67126566 67835574 0.99
tpcds_q12/duckdb:vortex-file-compressed 16933695 17190724 0.99
tpcds_q13/duckdb:vortex-file-compressed 32556516 33582969 0.97
tpcds_q14/duckdb:vortex-file-compressed 98480139 101517548 0.97
tpcds_q15/duckdb:vortex-file-compressed 28389074 29525789 0.96
tpcds_q16/duckdb:vortex-file-compressed 26137751 28142417 0.93
tpcds_q17/duckdb:vortex-file-compressed 45025386 46835260 0.96
tpcds_q18/duckdb:vortex-file-compressed 37728728 38875717 0.97
tpcds_q19/duckdb:vortex-file-compressed 34003741 35618000 0.95
tpcds_q20/duckdb:vortex-file-compressed 17218843 18075422 0.95
tpcds_q21/duckdb:vortex-file-compressed 16189231 16755842 0.97
tpcds_q22/duckdb:vortex-file-compressed 76168782 77812172 0.98
tpcds_q23/duckdb:vortex-file-compressed 94492950 96230763 0.98
tpcds_q24/duckdb:vortex-file-compressed 47308160 50822317 0.93
tpcds_q25/duckdb:vortex-file-compressed 42226241 43096914 0.98
tpcds_q26/duckdb:vortex-file-compressed 19273230 20930512 0.92
tpcds_q27/duckdb:vortex-file-compressed 22894890 23249729 0.98
tpcds_q28/duckdb:vortex-file-compressed 13001442 12769104 1.02
tpcds_q29/duckdb:vortex-file-compressed 40436214 43872226 0.92
tpcds_q30/duckdb:vortex-file-compressed 27283671 26204563 1.04
tpcds_q31/duckdb:vortex-file-compressed 30155048 29455301 1.02
tpcds_q32/duckdb:vortex-file-compressed 🚀 13258323 14781028 0.90
tpcds_q33/duckdb:vortex-file-compressed 23964094 23965448 1.00
tpcds_q34/duckdb:vortex-file-compressed 25470470 27193147 0.94
tpcds_q35/duckdb:vortex-file-compressed 66356906 65537134 1.01
tpcds_q36/duckdb:vortex-file-compressed 24785693 24178754 1.03
tpcds_q37/duckdb:vortex-file-compressed 20321444 20839975 0.98
tpcds_q38/duckdb:vortex-file-compressed 37923569 38909423 0.97
tpcds_q39/duckdb:vortex-file-compressed 36760828 35960456 1.02
tpcds_q40/duckdb:vortex-file-compressed 21081324 21181739 1.00
tpcds_q41/duckdb:vortex-file-compressed 10448592 10706318 0.98
tpcds_q42/duckdb:vortex-file-compressed 13654054 13443269 1.02
tpcds_q43/duckdb:vortex-file-compressed 21589618 22051304 0.98
tpcds_q44/duckdb:vortex-file-compressed 21848956 21491136 1.02
tpcds_q45/duckdb:vortex-file-compressed 32308530 31486665 1.03
tpcds_q46/duckdb:vortex-file-compressed 33235527 31099360 1.07
tpcds_q47/duckdb:vortex-file-compressed 52156165 54491559 0.96
tpcds_q48/duckdb:vortex-file-compressed 29486612 31777503 0.93
tpcds_q49/duckdb:vortex-file-compressed 34245745 32513480 1.05
tpcds_q50/duckdb:vortex-file-compressed 26441270 26082121 1.01
tpcds_q51/duckdb:vortex-file-compressed 106213026 107826599 0.99
tpcds_q52/duckdb:vortex-file-compressed 13886045 13583840 1.02
tpcds_q53/duckdb:vortex-file-compressed 22464563 23130261 0.97
tpcds_q54/duckdb:vortex-file-compressed 28509845 30279746 0.94
tpcds_q55/duckdb:vortex-file-compressed 12585146 13295567 0.95
tpcds_q56/duckdb:vortex-file-compressed 25823423 26497606 0.97
tpcds_q57/duckdb:vortex-file-compressed 42030515 43284679 0.97
tpcds_q58/duckdb:vortex-file-compressed 29837081 30470573 0.98
tpcds_q59/duckdb:vortex-file-compressed 55708279 57233449 0.97
tpcds_q60/duckdb:vortex-file-compressed 28107106 27582891 1.02
tpcds_q61/duckdb:vortex-file-compressed 30821519 31591753 0.98
tpcds_q62/duckdb:vortex-file-compressed 16327414 17665392 0.92
tpcds_q63/duckdb:vortex-file-compressed 20790800 22771148 0.91
tpcds_q64/duckdb:vortex-file-compressed 100673577 99233945 1.01
tpcds_q65/duckdb:vortex-file-compressed 22269451 23431429 0.95
tpcds_q66/duckdb:vortex-file-compressed 30227049 31424192 0.96
tpcds_q67/duckdb:vortex-file-compressed 142241780 144125918 0.99
tpcds_q68/duckdb:vortex-file-compressed 30551653 31857816 0.96
tpcds_q69/duckdb:vortex-file-compressed 41580778 41789425 1.00
tpcds_q70/duckdb:vortex-file-compressed 37793675 36936942 1.02
tpcds_q71/duckdb:vortex-file-compressed 20599838 22274942 0.92
tpcds_q72/duckdb:vortex-file-compressed 172157949 171635564 1.00
tpcds_q73/duckdb:vortex-file-compressed 24709637 25911655 0.95
tpcds_q74/duckdb:vortex-file-compressed 42985829 42795835 1.00
tpcds_q75/duckdb:vortex-file-compressed 50673626 51474493 0.98
tpcds_q76/duckdb:vortex-file-compressed 21261255 21217374 1.00
tpcds_q77/duckdb:vortex-file-compressed 25648921 27233115 0.94
tpcds_q78/duckdb:vortex-file-compressed 79909683 80488427 0.99
tpcds_q79/duckdb:vortex-file-compressed 24121616 25676176 0.94
tpcds_q80/duckdb:vortex-file-compressed 49540910 51607517 0.96
tpcds_q81/duckdb:vortex-file-compressed 31129828 31131832 1.00
tpcds_q82/duckdb:vortex-file-compressed 46887406 47237017 0.99
tpcds_q83/duckdb:vortex-file-compressed 26144428 28235130 0.93
tpcds_q84/duckdb:vortex-file-compressed 17007288 17597153 0.97
tpcds_q85/duckdb:vortex-file-compressed 40006665 42851400 0.93
tpcds_q86/duckdb:vortex-file-compressed 17124034 17192478 1.00
tpcds_q87/duckdb:vortex-file-compressed 40563038 41790446 0.97
tpcds_q88/duckdb:vortex-file-compressed 51626265 53350088 0.97
tpcds_q89/duckdb:vortex-file-compressed 22909723 22680983 1.01
tpcds_q90/duckdb:vortex-file-compressed 10153347 11181339 0.91
tpcds_q91/duckdb:vortex-file-compressed 🚀 21992561 24521020 0.90
tpcds_q92/duckdb:vortex-file-compressed 🚀 19483606 21718440 0.90
tpcds_q93/duckdb:vortex-file-compressed 29168019 31347935 0.93
tpcds_q94/duckdb:vortex-file-compressed 22912284 22761363 1.01
tpcds_q95/duckdb:vortex-file-compressed 147134942 156392670 0.94
tpcds_q96/duckdb:vortex-file-compressed 13192553 12651768 1.04
tpcds_q97/duckdb:vortex-file-compressed 38417140 40386952 0.95
tpcds_q98/duckdb:vortex-file-compressed 19409621 19708645 0.98
tpcds_q99/duckdb:vortex-file-compressed 22419233 23385075 0.96
duckdb / vortex-compact (0.973x ➖, 1↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25195500 26393188 0.95
tpcds_q02/duckdb:vortex-compact 37616022 41637915 0.90
tpcds_q03/duckdb:vortex-compact 49564784 49750760 1.00
tpcds_q04/duckdb:vortex-compact 106002914 111695396 0.95
tpcds_q05/duckdb:vortex-compact 41447203 43308855 0.96
tpcds_q06/duckdb:vortex-compact 39220583 40140992 0.98
tpcds_q07/duckdb:vortex-compact 35209390 35952211 0.98
tpcds_q08/duckdb:vortex-compact 42070641 41444735 1.02
tpcds_q09/duckdb:vortex-compact 19675669 20891976 0.94
tpcds_q10/duckdb:vortex-compact 53147237 54010472 0.98
tpcds_q11/duckdb:vortex-compact 76136543 76839610 0.99
tpcds_q12/duckdb:vortex-compact 22590366 22913112 0.99
tpcds_q13/duckdb:vortex-compact 53672023 54276101 0.99
tpcds_q14/duckdb:vortex-compact 124351257 121386127 1.02
tpcds_q15/duckdb:vortex-compact 30237773 31591553 0.96
tpcds_q16/duckdb:vortex-compact 28657402 29217730 0.98
tpcds_q17/duckdb:vortex-compact 55591820 57489535 0.97
tpcds_q18/duckdb:vortex-compact 49285827 51740130 0.95
tpcds_q19/duckdb:vortex-compact 46105816 46518739 0.99
tpcds_q20/duckdb:vortex-compact 21684200 22576176 0.96
tpcds_q21/duckdb:vortex-compact 18712290 18933024 0.99
tpcds_q22/duckdb:vortex-compact 76156660 83002660 0.92
tpcds_q23/duckdb:vortex-compact 109736168 113851068 0.96
tpcds_q24/duckdb:vortex-compact 58705222 59964812 0.98
tpcds_q25/duckdb:vortex-compact 55246781 56497044 0.98
tpcds_q26/duckdb:vortex-compact 32580950 32766589 0.99
tpcds_q27/duckdb:vortex-compact 36508594 37396347 0.98
tpcds_q28/duckdb:vortex-compact 36192778 35954260 1.01
tpcds_q29/duckdb:vortex-compact 54221816 55761075 0.97
tpcds_q30/duckdb:vortex-compact 31761670 31426997 1.01
tpcds_q31/duckdb:vortex-compact 37008409 40547054 0.91
tpcds_q32/duckdb:vortex-compact 23193842 22906133 1.01
tpcds_q33/duckdb:vortex-compact 34037279 32685993 1.04
tpcds_q34/duckdb:vortex-compact 31299215 31042517 1.01
tpcds_q35/duckdb:vortex-compact 76879320 78568681 0.98
tpcds_q36/duckdb:vortex-compact 36334744 37176189 0.98
tpcds_q37/duckdb:vortex-compact 23841149 25897532 0.92
tpcds_q38/duckdb:vortex-compact 40700797 44745888 0.91
tpcds_q39/duckdb:vortex-compact 38644964 40960169 0.94
tpcds_q40/duckdb:vortex-compact 24811907 25922018 0.96
tpcds_q41/duckdb:vortex-compact 12006009 12573296 0.95
tpcds_q42/duckdb:vortex-compact 19479392 19841713 0.98
tpcds_q43/duckdb:vortex-compact 33618726 32296156 1.04
tpcds_q44/duckdb:vortex-compact 29169939 29431298 0.99
tpcds_q45/duckdb:vortex-compact 35953976 37295625 0.96
tpcds_q46/duckdb:vortex-compact 45864120 47707011 0.96
tpcds_q47/duckdb:vortex-compact 63955508 64299154 0.99
tpcds_q48/duckdb:vortex-compact 45897282 46114335 1.00
tpcds_q49/duckdb:vortex-compact 47064968 51025898 0.92
tpcds_q50/duckdb:vortex-compact 40199915 39047620 1.03
tpcds_q51/duckdb:vortex-compact 112437050 115432818 0.97
tpcds_q52/duckdb:vortex-compact 20022838 19862391 1.01
tpcds_q53/duckdb:vortex-compact 33371930 33399810 1.00
tpcds_q54/duckdb:vortex-compact 38134637 39285729 0.97
tpcds_q55/duckdb:vortex-compact 19247786 20506398 0.94
tpcds_q56/duckdb:vortex-compact 33759841 33723802 1.00
tpcds_q57/duckdb:vortex-compact 45729034 46983896 0.97
tpcds_q58/duckdb:vortex-compact 37744081 38109725 0.99
tpcds_q59/duckdb:vortex-compact 65598034 69303850 0.95
tpcds_q60/duckdb:vortex-compact 36206648 35070771 1.03
tpcds_q61/duckdb:vortex-compact 55270475 55320423 1.00
tpcds_q62/duckdb:vortex-compact 22332385 22612739 0.99
tpcds_q63/duckdb:vortex-compact 31325859 32706810 0.96
tpcds_q64/duckdb:vortex-compact 124329756 130890719 0.95
tpcds_q65/duckdb:vortex-compact 31609812 31844881 0.99
tpcds_q66/duckdb:vortex-compact 35846283 37037214 0.97
tpcds_q67/duckdb:vortex-compact 151612119 155933377 0.97
tpcds_q68/duckdb:vortex-compact 45524156 48669529 0.94
tpcds_q69/duckdb:vortex-compact 55780274 57289312 0.97
tpcds_q70/duckdb:vortex-compact 58384286 58731960 0.99
tpcds_q71/duckdb:vortex-compact 29229906 32338952 0.90
tpcds_q72/duckdb:vortex-compact 191687937 189623978 1.01
tpcds_q73/duckdb:vortex-compact 29108720 29816345 0.98
tpcds_q74/duckdb:vortex-compact 48206446 49571830 0.97
tpcds_q75/duckdb:vortex-compact 62850118 63886209 0.98
tpcds_q76/duckdb:vortex-compact 🚀 28775023 32804017 0.88
tpcds_q77/duckdb:vortex-compact 39063891 37578182 1.04
tpcds_q78/duckdb:vortex-compact 87320097 87373765 1.00
tpcds_q79/duckdb:vortex-compact 39235561 41270440 0.95
tpcds_q80/duckdb:vortex-compact 73386949 72980240 1.01
tpcds_q81/duckdb:vortex-compact 33713222 35811044 0.94
tpcds_q82/duckdb:vortex-compact 49749411 52458152 0.95
tpcds_q83/duckdb:vortex-compact 38228210 38122190 1.00
tpcds_q84/duckdb:vortex-compact 22831131 23987244 0.95
tpcds_q85/duckdb:vortex-compact 53427166 56793495 0.94
tpcds_q86/duckdb:vortex-compact 21047961 21553358 0.98
tpcds_q87/duckdb:vortex-compact 44273657 46715821 0.95
tpcds_q88/duckdb:vortex-compact 75217859 77756279 0.97
tpcds_q89/duckdb:vortex-compact 33606691 33954186 0.99
tpcds_q90/duckdb:vortex-compact 11805099 12512067 0.94
tpcds_q91/duckdb:vortex-compact 41228156 43463609 0.95
tpcds_q92/duckdb:vortex-compact 46505870 43292687 1.07
tpcds_q93/duckdb:vortex-compact 32820242 34395591 0.95
tpcds_q94/duckdb:vortex-compact 28623715 28560348 1.00
tpcds_q95/duckdb:vortex-compact 157752101 164039353 0.96
tpcds_q96/duckdb:vortex-compact 16186440 16897198 0.96
tpcds_q97/duckdb:vortex-compact 43212273 44162140 0.98
tpcds_q98/duckdb:vortex-compact 27360407 28205437 0.97
tpcds_q99/duckdb:vortex-compact 26441641 29085734 0.91
duckdb / parquet (0.987x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29386539 31996628 0.92
tpcds_q02/duckdb:parquet 24129178 23683874 1.02
tpcds_q03/duckdb:parquet 13529314 13353271 1.01
tpcds_q04/duckdb:parquet 169479347 174884756 0.97
tpcds_q05/duckdb:parquet 32075395 33212350 0.97
tpcds_q06/duckdb:parquet 33498079 34824598 0.96
tpcds_q07/duckdb:parquet 24486058 24793783 0.99
tpcds_q08/duckdb:parquet 29621740 30071005 0.99
tpcds_q09/duckdb:parquet 45150196 44499241 1.01
tpcds_q10/duckdb:parquet 38502742 38981775 0.99
tpcds_q11/duckdb:parquet 95653580 97168611 0.98
tpcds_q12/duckdb:parquet 17117977 17462419 0.98
tpcds_q13/duckdb:parquet 35480217 35654082 1.00
tpcds_q14/duckdb:parquet 102767211 102220070 1.01
tpcds_q15/duckdb:parquet 31108803 31672914 0.98
tpcds_q16/duckdb:parquet 22802201 23281344 0.98
tpcds_q17/duckdb:parquet 41129546 41864666 0.98
tpcds_q18/duckdb:parquet 49275700 49870429 0.99
tpcds_q19/duckdb:parquet 31950688 32392643 0.99
tpcds_q20/duckdb:parquet 18712286 19380960 0.97
tpcds_q21/duckdb:parquet 11676886 12263016 0.95
tpcds_q22/duckdb:parquet 72354046 68082650 1.06
tpcds_q23/duckdb:parquet 80886883 81262576 1.00
tpcds_q24/duckdb:parquet 47460053 48504633 0.98
tpcds_q25/duckdb:parquet 35585005 36925989 0.96
tpcds_q26/duckdb:parquet 39394452 41768297 0.94
tpcds_q27/duckdb:parquet 52630749 53883756 0.98
tpcds_q28/duckdb:parquet 42730686 43035720 0.99
tpcds_q29/duckdb:parquet 38873344 39841283 0.98
tpcds_q30/duckdb:parquet 37454258 38833642 0.96
tpcds_q31/duckdb:parquet 26662893 27724558 0.96
tpcds_q32/duckdb:parquet 12714409 13073417 0.97
tpcds_q33/duckdb:parquet 24629936 24710422 1.00
tpcds_q34/duckdb:parquet 23411268 23104336 1.01
tpcds_q35/duckdb:parquet 63223906 63639027 0.99
tpcds_q36/duckdb:parquet 22954898 23190770 0.99
tpcds_q37/duckdb:parquet 14792598 14866365 1.00
tpcds_q38/duckdb:parquet 37177437 37847305 0.98
tpcds_q39/duckdb:parquet 32978963 32962841 1.00
tpcds_q40/duckdb:parquet 20346355 20653563 0.99
tpcds_q41/duckdb:parquet 9139445 9427668 0.97
tpcds_q42/duckdb:parquet 12502979 12634900 0.99
tpcds_q43/duckdb:parquet 17866862 18289029 0.98
tpcds_q44/duckdb:parquet 26773250 27002960 0.99
tpcds_q45/duckdb:parquet 29667172 29916534 0.99
tpcds_q46/duckdb:parquet 48332122 49404072 0.98
tpcds_q47/duckdb:parquet 51927083 51346230 1.01
tpcds_q48/duckdb:parquet 32498615 32570136 1.00
tpcds_q49/duckdb:parquet 28568162 29584555 0.97
tpcds_q50/duckdb:parquet 26443296 26499880 1.00
tpcds_q51/duckdb:parquet 105522373 105574482 1.00
tpcds_q52/duckdb:parquet 12476257 13222965 0.94
tpcds_q53/duckdb:parquet 19681510 19419226 1.01
tpcds_q54/duckdb:parquet 29431048 29496288 1.00
tpcds_q55/duckdb:parquet 12808847 12421439 1.03
tpcds_q56/duckdb:parquet 24337180 24684509 0.99
tpcds_q57/duckdb:parquet 38730012 39136653 0.99
tpcds_q58/duckdb:parquet 25843532 26495978 0.98
tpcds_q59/duckdb:parquet 36519856 36664815 1.00
tpcds_q60/duckdb:parquet 24366483 26329027 0.93
tpcds_q61/duckdb:parquet 33569510 34785247 0.97
tpcds_q62/duckdb:parquet 12902709 13019985 0.99
tpcds_q63/duckdb:parquet 17723339 18455464 0.96
tpcds_q64/duckdb:parquet 78708612 76365878 1.03
tpcds_q65/duckdb:parquet 22413561 22666660 0.99
tpcds_q66/duckdb:parquet 29951399 30081033 1.00
tpcds_q67/duckdb:parquet 138662721 139142145 1.00
tpcds_q68/duckdb:parquet 39054049 39341825 0.99
tpcds_q69/duckdb:parquet 39114705 39002237 1.00
tpcds_q70/duckdb:parquet 22902637 23399814 0.98
tpcds_q71/duckdb:parquet 22987494 23553360 0.98
tpcds_q72/duckdb:parquet 167911904 169606578 0.99
tpcds_q73/duckdb:parquet 21004942 21059101 1.00
tpcds_q74/duckdb:parquet 129398487 129296253 1.00
tpcds_q75/duckdb:parquet 59220958 60279328 0.98
tpcds_q76/duckdb:parquet 23164409 22141721 1.05
tpcds_q77/duckdb:parquet 25965667 25600869 1.01
tpcds_q78/duckdb:parquet 77710536 78392998 0.99
tpcds_q79/duckdb:parquet 29975203 30613715 0.98
tpcds_q80/duckdb:parquet 43469569 44540824 0.98
tpcds_q81/duckdb:parquet 35840833 35473657 1.01
tpcds_q82/duckdb:parquet 17612539 17999762 0.98
tpcds_q83/duckdb:parquet 18623282 19397081 0.96
tpcds_q84/duckdb:parquet 22145237 20972080 1.06
tpcds_q85/duckdb:parquet 43064273 42816438 1.01
tpcds_q86/duckdb:parquet 13866427 14104247 0.98
tpcds_q87/duckdb:parquet 40294110 40485963 1.00
tpcds_q88/duckdb:parquet 53837843 54622332 0.99
tpcds_q89/duckdb:parquet 21028992 22137156 0.95
tpcds_q90/duckdb:parquet 8423119 8543907 0.99
tpcds_q91/duckdb:parquet 25973695 25973587 1.00
tpcds_q92/duckdb:parquet 13343401 13771296 0.97
tpcds_q93/duckdb:parquet 32480100 33753686 0.96
tpcds_q94/duckdb:parquet 18212839 18673869 0.98
tpcds_q95/duckdb:parquet 146919872 148638538 0.99
tpcds_q96/duckdb:parquet 11095689 10641100 1.04
tpcds_q97/duckdb:parquet 38564423 40092920 0.96
tpcds_q98/duckdb:parquet 24883279 25319243 0.98
tpcds_q99/duckdb:parquet 20451528 20819450 0.98
duckdb / duckdb (0.990x ➖, 3↑ 1↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22559301 22849798 0.99
tpcds_q02/duckdb:duckdb 19260162 19200731 1.00
tpcds_q03/duckdb:duckdb 10507085 11029264 0.95
tpcds_q04/duckdb:duckdb 181079261 183903849 0.98
tpcds_q05/duckdb:duckdb 23037244 24461136 0.94
tpcds_q06/duckdb:duckdb 29678934 28550144 1.04
tpcds_q07/duckdb:duckdb 41967345 42119185 1.00
tpcds_q08/duckdb:duckdb 120037890 121268938 0.99
tpcds_q09/duckdb:duckdb 20924804 20962725 1.00
tpcds_q10/duckdb:duckdb 27980488 28661245 0.98
tpcds_q11/duckdb:duckdb 90210198 91741622 0.98
tpcds_q12/duckdb:duckdb 14401762 14571718 0.99
tpcds_q13/duckdb:duckdb 26894203 26977122 1.00
tpcds_q14/duckdb:duckdb 94380245 92872842 1.02
tpcds_q15/duckdb:duckdb 25550807 25895980 0.99
tpcds_q16/duckdb:duckdb 20077146 19728310 1.02
tpcds_q17/duckdb:duckdb 24431110 25067735 0.97
tpcds_q18/duckdb:duckdb 49883559 48706688 1.02
tpcds_q19/duckdb:duckdb 19197494 19880809 0.97
tpcds_q20/duckdb:duckdb 14552257 14841128 0.98
tpcds_q21/duckdb:duckdb 🚀 7739940 9074590 0.85
tpcds_q22/duckdb:duckdb 63296465 64298885 0.98
tpcds_q23/duckdb:duckdb 75182424 76460011 0.98
tpcds_q24/duckdb:duckdb 26279164 26361458 1.00
tpcds_q25/duckdb:duckdb 19417304 19775402 0.98
tpcds_q26/duckdb:duckdb 28945503 29378806 0.99
tpcds_q27/duckdb:duckdb 42383558 42474668 1.00
tpcds_q28/duckdb:duckdb 25322340 25081685 1.01
tpcds_q29/duckdb:duckdb 23563227 23855137 0.99
tpcds_q30/duckdb:duckdb 31903834 31761397 1.00
tpcds_q31/duckdb:duckdb 51955579 54795807 0.95
tpcds_q32/duckdb:duckdb 8506162 9333373 0.91
tpcds_q33/duckdb:duckdb 17180605 16613789 1.03
tpcds_q34/duckdb:duckdb 18955115 19030966 1.00
tpcds_q35/duckdb:duckdb 37759653 38565039 0.98
tpcds_q36/duckdb:duckdb 71978107 74434110 0.97
tpcds_q37/duckdb:duckdb 9110866 9507837 0.96
tpcds_q38/duckdb:duckdb 🚨 37821337 33927067 1.11
tpcds_q39/duckdb:duckdb 27905457 29055496 0.96
tpcds_q40/duckdb:duckdb 15296362 15664700 0.98
tpcds_q41/duckdb:duckdb 9771646 9883070 0.99
tpcds_q42/duckdb:duckdb 9511091 9454173 1.01
tpcds_q43/duckdb:duckdb 14573738 15320400 0.95
tpcds_q44/duckdb:duckdb 15855867 15783321 1.00
tpcds_q45/duckdb:duckdb 19592275 19585152 1.00
tpcds_q46/duckdb:duckdb 40326072 39895267 1.01
tpcds_q47/duckdb:duckdb 47109868 48133650 0.98
tpcds_q48/duckdb:duckdb 25454247 24674274 1.03
tpcds_q49/duckdb:duckdb 22031802 20765341 1.06
tpcds_q50/duckdb:duckdb 16427570 16877567 0.97
tpcds_q51/duckdb:duckdb 101570125 102999744 0.99
tpcds_q52/duckdb:duckdb 10320101 9777157 1.06
tpcds_q53/duckdb:duckdb 18160425 17619422 1.03
tpcds_q54/duckdb:duckdb 19672144 19808849 0.99
tpcds_q55/duckdb:duckdb 10553530 10008830 1.05
tpcds_q56/duckdb:duckdb 16837458 16694192 1.01
tpcds_q57/duckdb:duckdb 37403737 37480221 1.00
tpcds_q58/duckdb:duckdb 17561777 16776817 1.05
tpcds_q59/duckdb:duckdb 37103804 37830330 0.98
tpcds_q60/duckdb:duckdb 19505753 18504812 1.05
tpcds_q61/duckdb:duckdb 16986369 16977333 1.00
tpcds_q62/duckdb:duckdb 10244360 10385104 0.99
tpcds_q63/duckdb:duckdb 16772814 17196803 0.98
tpcds_q64/duckdb:duckdb 59401658 59690437 1.00
tpcds_q65/duckdb:duckdb 37551161 37827127 0.99
tpcds_q66/duckdb:duckdb 26867848 27450370 0.98
tpcds_q67/duckdb:duckdb 134573721 135607361 0.99
tpcds_q68/duckdb:duckdb 28216542 27072271 1.04
tpcds_q69/duckdb:duckdb 28483249 28555129 1.00
tpcds_q70/duckdb:duckdb 17708685 17593201 1.01
tpcds_q71/duckdb:duckdb 17146844 16933511 1.01
tpcds_q72/duckdb:duckdb 46793643 47543334 0.98
tpcds_q73/duckdb:duckdb 14622139 13355549 1.09
tpcds_q74/duckdb:duckdb 149985343 147879065 1.01
tpcds_q75/duckdb:duckdb 46283160 47729679 0.97
tpcds_q76/duckdb:duckdb 15144897 15081203 1.00
tpcds_q77/duckdb:duckdb 15692298 16125866 0.97
tpcds_q78/duckdb:duckdb 66817956 68011734 0.98
tpcds_q79/duckdb:duckdb 21185550 20516695 1.03
tpcds_q80/duckdb:duckdb 🚀 31458025 36102906 0.87
tpcds_q81/duckdb:duckdb 41149753 40120958 1.03
tpcds_q82/duckdb:duckdb 10315276 11407243 0.90
tpcds_q83/duckdb:duckdb 11091588 11511658 0.96
tpcds_q84/duckdb:duckdb 15039259 15450034 0.97
tpcds_q85/duckdb:duckdb 28049293 27077985 1.04
tpcds_q86/duckdb:duckdb 12389848 12779389 0.97
tpcds_q87/duckdb:duckdb 36415917 36806827 0.99
tpcds_q88/duckdb:duckdb 29612622 29652734 1.00
tpcds_q89/duckdb:duckdb 22093845 22688881 0.97
tpcds_q90/duckdb:duckdb 6401186 6838972 0.94
tpcds_q91/duckdb:duckdb 15126530 15281562 0.99
tpcds_q92/duckdb:duckdb 10182861 10570423 0.96
tpcds_q93/duckdb:duckdb 24808204 25159961 0.99
tpcds_q94/duckdb:duckdb 15601043 14939868 1.04
tpcds_q95/duckdb:duckdb 🚀 113397177 132726639 0.85
tpcds_q96/duckdb:duckdb 6088903 6210322 0.98
tpcds_q97/duckdb:duckdb 32854311 33791839 0.97
tpcds_q98/duckdb:duckdb 20925586 20805388 1.01
tpcds_q99/duckdb:duckdb 17309555 17554392 0.99
File Size Changes (7 files changed, +0.0% overall, 4↑ 3↓)
File Scale Format Base HEAD Change %
date_dim.vortex 1.0 vortex-file-compressed 964.11 KB 1.03 MB +91.28 KB +9.5%
customer_address.vortex 1.0 vortex-file-compressed 826.43 KB 829.18 KB +2.75 KB +0.3%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB +2.77 KB +0.2%
item.vortex 1.0 vortex-compact 994.25 KB 994.50 KB +256 B +0.0%
catalog_page.vortex 1.0 vortex-file-compressed 571.31 KB 571.30 KB 16 B -0.0%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.27 MB 2.26 KB -0.1%
time_dim.vortex 1.0 vortex-file-compressed 380.09 KB 376.27 KB 3.81 KB -1.0%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 271.76 MB → 271.85 MB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.7% -5.6% +2.1% +18.5% ➖ noise
1 datafusion:vortex-file-compressed -4.1% -5.6% +1.6% +18.8% ➖ noise
1 duckdb:duckdb -1.3% -5.6% +4.6% +17.7% ➖ noise
1 duckdb:vortex-compact -4.5% -5.6% +1.1% +24.9% ➖ noise
1 duckdb:vortex-file-compressed -3.0% -5.6% +2.8% +26.4% ➖ noise
2 datafusion:vortex-compact -0.8% -2.6% +1.9% +14.3% ➖ noise
2 datafusion:vortex-file-compressed -3.0% -2.6% -0.4% +10.0% ➖ noise
2 duckdb:duckdb +0.3% -2.6% +3.0% +10.0% ➖ noise
2 duckdb:vortex-compact -9.7% -2.6% -7.2% +27.2% ➖ noise
2 duckdb:vortex-file-compressed -1.3% -2.6% +1.4% +26.1% ➖ noise
3 datafusion:vortex-compact -1.3% -0.5% -0.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -4.3% -0.5% -3.8% +10.0% ➖ noise
3 duckdb:duckdb -4.7% -0.5% -4.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.4% -0.5% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.1% -0.5% +0.4% +10.0% ➖ noise
4 datafusion:vortex-compact -2.7% -1.4% -1.2% +10.3% ➖ noise
4 datafusion:vortex-file-compressed -4.6% -1.4% -3.2% +10.0% ➖ noise
4 duckdb:duckdb -1.5% -1.4% -0.1% +10.0% ➖ noise
4 duckdb:vortex-compact -5.1% -1.4% -3.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.1% -1.4% +4.6% +11.8% ➖ noise
5 datafusion:vortex-compact -4.5% -4.4% -0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.3% -4.4% -1.0% +10.0% ➖ noise
5 duckdb:duckdb -5.8% -4.4% -1.5% +13.9% ➖ noise
5 duckdb:vortex-compact -4.3% -4.4% +0.1% +11.0% ➖ noise
5 duckdb:vortex-file-compressed -8.1% -4.4% -3.9% +15.5% ➖ noise
6 datafusion:vortex-compact +8.4% -1.9% +10.5% +16.5% ➖ noise
6 datafusion:vortex-file-compressed -1.3% -1.9% +0.5% +14.9% ➖ noise
6 duckdb:duckdb +4.0% -1.9% +5.9% +10.0% ➖ noise
6 duckdb:vortex-compact -2.3% -1.9% -0.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -5.6% -1.9% -3.8% +10.0% ➖ noise
7 datafusion:vortex-compact +0.8% -1.3% +2.1% +19.6% ➖ noise
7 datafusion:vortex-file-compressed -4.7% -1.3% -3.5% +15.8% ➖ noise
7 duckdb:duckdb -0.4% -1.3% +0.9% +10.0% ➖ noise
7 duckdb:vortex-compact -2.1% -1.3% -0.8% +26.6% ➖ noise
7 duckdb:vortex-file-compressed -3.9% -1.3% -2.6% +10.0% ➖ noise
8 datafusion:vortex-compact -1.0% -2.4% +1.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -4.3% -2.4% -1.9% +10.0% ➖ noise
8 duckdb:duckdb -1.0% -2.4% +1.4% +10.0% ➖ noise
8 duckdb:vortex-compact +1.5% -2.4% +4.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -7.0% -2.4% -4.7% +29.7% ➖ noise
9 datafusion:vortex-compact -3.4% +1.1% -4.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -3.3% +1.1% -4.3% +10.0% ➖ noise
9 duckdb:duckdb -0.2% +1.1% -1.3% +10.0% ➖ noise
9 duckdb:vortex-compact -5.8% +1.1% -6.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.7% +1.1% -2.7% +18.6% ➖ noise
10 datafusion:vortex-compact +0.3% -1.1% +1.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -5.9% -1.1% -4.9% +15.2% ➖ noise
10 duckdb:duckdb -2.4% -1.1% -1.3% +10.0% ➖ noise
10 duckdb:vortex-compact -1.6% -1.1% -0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.8% -1.1% +0.2% +10.0% ➖ noise
11 datafusion:vortex-compact -4.5% -2.9% -1.7% +10.8% ➖ noise
11 datafusion:vortex-file-compressed -2.6% -2.9% +0.3% +10.0% ➖ noise
11 duckdb:duckdb -1.7% -2.9% +1.3% +10.0% ➖ noise
11 duckdb:vortex-compact -0.9% -2.9% +2.0% +11.2% ➖ noise
11 duckdb:vortex-file-compressed -1.0% -2.9% +1.9% +10.0% ➖ noise
12 datafusion:vortex-compact +15.6% -1.6% +17.5% +12.9% 🚨 regression
12 datafusion:vortex-file-compressed -1.4% -1.6% +0.3% +13.0% ➖ noise
12 duckdb:duckdb -1.2% -1.6% +0.5% +10.0% ➖ noise
12 duckdb:vortex-compact -1.4% -1.6% +0.2% +10.6% ➖ noise
12 duckdb:vortex-file-compressed -1.5% -1.6% +0.1% +44.9% ➖ noise
13 datafusion:vortex-compact -9.6% -1.3% -8.4% +19.7% ➖ noise
13 datafusion:vortex-file-compressed -1.2% -1.3% +0.0% +11.2% ➖ noise
13 duckdb:duckdb -0.3% -1.3% +1.0% +10.0% ➖ noise
13 duckdb:vortex-compact -1.1% -1.3% +0.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -3.1% -1.3% -1.8% +10.0% ➖ noise
14 datafusion:vortex-compact -5.2% -0.1% -5.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -5.4% -0.1% -5.3% +10.0% ➖ noise
14 duckdb:duckdb +1.6% -0.1% +1.7% +10.0% ➖ noise
14 duckdb:vortex-compact +2.4% -0.1% +2.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.0% -0.1% -2.9% +10.0% ➖ noise
15 datafusion:vortex-compact -1.2% -5.6% +4.6% +11.0% ➖ noise
15 datafusion:vortex-file-compressed +1.4% -5.6% +7.3% +20.2% ➖ noise
15 duckdb:duckdb -1.3% -5.6% +4.5% +10.0% ➖ noise
15 duckdb:vortex-compact -4.3% -5.6% +1.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -3.8% -5.6% +1.8% +18.5% ➖ noise
16 datafusion:vortex-compact +2.6% -10.1% +14.1% +22.1% ➖ noise
16 datafusion:vortex-file-compressed -2.2% -10.1% +8.7% +13.3% ➖ noise
16 duckdb:duckdb +1.8% -10.1% +13.2% +14.4% ➖ noise
16 duckdb:vortex-compact -1.9% -10.1% +9.1% +26.5% ➖ noise
16 duckdb:vortex-file-compressed -7.1% -10.1% +3.3% +15.4% ➖ noise
17 datafusion:vortex-compact -5.5% -3.5% -2.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.5% -3.5% +5.2% +10.0% ➖ noise
17 duckdb:duckdb -2.5% -3.5% +1.0% +10.0% ➖ noise
17 duckdb:vortex-compact -3.3% -3.5% +0.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -3.9% -3.5% -0.4% +10.0% ➖ noise
18 datafusion:vortex-compact -5.4% -4.5% -0.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -4.3% -4.5% +0.3% +10.0% ➖ noise
18 duckdb:duckdb +2.4% -4.5% +7.3% +10.0% ➖ noise
18 duckdb:vortex-compact -4.7% -4.5% -0.2% +13.2% ➖ noise
18 duckdb:vortex-file-compressed -3.0% -4.5% +1.7% +19.7% ➖ noise
19 datafusion:vortex-compact +6.6% -1.5% +8.3% +18.1% ➖ noise
19 datafusion:vortex-file-compressed +7.7% -1.5% +9.3% +20.3% ➖ noise
19 duckdb:duckdb -3.4% -1.5% -2.0% +10.0% ➖ noise
19 duckdb:vortex-compact -0.9% -1.5% +0.6% +17.1% ➖ noise
19 duckdb:vortex-file-compressed -4.5% -1.5% -3.1% +17.1% ➖ noise
20 datafusion:vortex-compact -1.4% -2.7% +1.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -7.4% -2.7% -4.9% +10.0% ➖ noise
20 duckdb:duckdb -1.9% -2.7% +0.7% +10.0% ➖ noise
20 duckdb:vortex-compact -4.0% -2.7% -1.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -4.7% -2.7% -2.1% +21.3% ➖ noise
21 datafusion:vortex-compact -5.5% -4.4% -1.2% +12.9% ➖ noise
21 datafusion:vortex-file-compressed -5.8% -4.4% -1.5% +13.1% ➖ noise
21 duckdb:duckdb -14.7% -4.4% -10.8% +17.7% ➖ noise
21 duckdb:vortex-compact -1.2% -4.4% +3.4% +12.8% ➖ noise
21 duckdb:vortex-file-compressed -3.4% -4.4% +1.0% +13.1% ➖ noise
22 datafusion:vortex-compact -4.2% -1.0% -3.3% +16.2% ➖ noise
22 datafusion:vortex-file-compressed +9.0% -1.0% +10.1% +22.8% ➖ noise
22 duckdb:duckdb -1.6% -1.0% -0.6% +10.6% ➖ noise
22 duckdb:vortex-compact -8.2% -1.0% -7.3% +11.2% ➖ noise
22 duckdb:vortex-file-compressed -2.1% -1.0% -1.1% +12.2% ➖ noise
23 datafusion:vortex-compact -1.2% -2.6% +1.4% +11.4% ➖ noise
23 datafusion:vortex-file-compressed -1.5% -2.6% +1.1% +10.0% ➖ noise
23 duckdb:duckdb -1.7% -2.6% +0.9% +10.1% ➖ noise
23 duckdb:vortex-compact -3.6% -2.6% -1.1% +13.0% ➖ noise
23 duckdb:vortex-file-compressed -1.8% -2.6% +0.8% +10.1% ➖ noise
24 datafusion:vortex-compact -2.3% -2.3% +0.0% +15.7% ➖ noise
24 datafusion:vortex-file-compressed -0.6% -2.3% +1.7% +12.4% ➖ noise
24 duckdb:duckdb -0.3% -2.3% +2.0% +10.0% ➖ noise
24 duckdb:vortex-compact -2.1% -2.3% +0.2% +11.4% ➖ noise
24 duckdb:vortex-file-compressed -6.9% -2.3% -4.8% +10.0% ➖ noise
25 datafusion:vortex-compact -5.3% -0.7% -4.6% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -3.1% -0.7% -2.4% +10.0% ➖ noise
25 duckdb:duckdb -1.8% -0.7% -1.1% +10.0% ➖ noise
25 duckdb:vortex-compact -2.2% -0.7% -1.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -2.0% -0.7% -1.3% +12.5% ➖ noise
26 datafusion:vortex-compact +6.9% -3.3% +10.5% +17.6% ➖ noise
26 datafusion:vortex-file-compressed -1.6% -3.3% +1.8% +10.0% ➖ noise
26 duckdb:duckdb -1.5% -3.3% +1.9% +10.0% ➖ noise
26 duckdb:vortex-compact -0.6% -3.3% +2.8% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -7.9% -3.3% -4.8% +10.0% ➖ noise
27 datafusion:vortex-compact -1.9% -1.7% -0.3% +11.2% ➖ noise
27 datafusion:vortex-file-compressed -0.5% -1.7% +1.1% +17.4% ➖ noise
27 duckdb:duckdb -0.2% -1.7% +1.5% +10.0% ➖ noise
27 duckdb:vortex-compact -2.4% -1.7% -0.7% +14.4% ➖ noise
27 duckdb:vortex-file-compressed -1.5% -1.7% +0.1% +10.0% ➖ noise
28 datafusion:vortex-compact +0.6% -1.7% +2.3% +15.9% ➖ noise
28 datafusion:vortex-file-compressed -0.4% -1.7% +1.3% +13.9% ➖ noise
28 duckdb:duckdb +1.0% -1.7% +2.7% +10.0% ➖ noise
28 duckdb:vortex-compact +0.7% -1.7% +2.4% +30.9% ➖ noise
28 duckdb:vortex-file-compressed +1.8% -1.7% +3.5% +12.2% ➖ noise
29 datafusion:vortex-compact -2.6% -2.0% -0.6% +11.2% ➖ noise
29 datafusion:vortex-file-compressed -3.7% -2.0% -1.7% +10.0% ➖ noise
29 duckdb:duckdb -1.2% -2.0% +0.8% +10.4% ➖ noise
29 duckdb:vortex-compact -2.8% -2.0% -0.8% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -7.8% -2.0% -5.9% +14.6% ➖ noise
30 datafusion:vortex-compact -4.5% -3.9% -0.7% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -6.2% -3.9% -2.5% +19.0% ➖ noise
30 duckdb:duckdb +0.4% -3.9% +4.5% +10.0% ➖ noise
30 duckdb:vortex-compact +1.1% -3.9% +5.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +4.1% -3.9% +8.3% +28.0% ➖ noise
31 datafusion:vortex-compact -3.5% -3.0% -0.5% +14.0% ➖ noise
31 datafusion:vortex-file-compressed -4.5% -3.0% -1.5% +10.0% ➖ noise
31 duckdb:duckdb -5.2% -3.0% -2.3% +10.0% ➖ noise
31 duckdb:vortex-compact -8.7% -3.0% -5.9% +19.6% ➖ noise
31 duckdb:vortex-file-compressed +2.4% -3.0% +5.5% +10.4% ➖ noise
32 datafusion:vortex-compact -9.4% -3.1% -6.5% +17.7% ➖ noise
32 datafusion:vortex-file-compressed +0.4% -3.1% +3.6% +10.0% ➖ noise
32 duckdb:duckdb -8.9% -3.1% -5.9% +10.0% ➖ noise
32 duckdb:vortex-compact +1.3% -3.1% +4.5% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -10.3% -3.1% -7.4% +10.0% ➖ noise
33 datafusion:vortex-compact -0.6% -1.1% +0.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -4.7% -1.1% -3.7% +10.0% ➖ noise
33 duckdb:duckdb +3.4% -1.1% +4.6% +10.0% ➖ noise
33 duckdb:vortex-compact +4.1% -1.1% +5.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -0.0% -1.1% +1.1% +10.0% ➖ noise
34 datafusion:vortex-compact -1.7% +0.0% -1.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -8.0% +0.0% -8.0% +13.6% ➖ noise
34 duckdb:duckdb -0.4% +0.0% -0.4% +10.0% ➖ noise
34 duckdb:vortex-compact +0.8% +0.0% +0.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -6.3% +0.0% -6.4% +11.5% ➖ noise
35 datafusion:vortex-compact +1.3% -0.8% +2.1% +18.2% ➖ noise
35 datafusion:vortex-file-compressed -2.8% -0.8% -2.1% +10.0% ➖ noise
35 duckdb:duckdb -2.1% -0.8% -1.3% +10.0% ➖ noise
35 duckdb:vortex-compact -2.2% -0.8% -1.4% +14.4% ➖ noise
35 duckdb:vortex-file-compressed +1.3% -0.8% +2.0% +10.0% ➖ noise
36 datafusion:vortex-compact -4.3% -0.8% -3.6% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -3.5% -0.8% -2.7% +10.0% ➖ noise
36 duckdb:duckdb -3.3% -0.8% -2.5% +10.0% ➖ noise
36 duckdb:vortex-compact -2.3% -0.8% -1.5% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +2.5% -0.8% +3.4% +10.0% ➖ noise
37 datafusion:vortex-compact -3.9% +0.3% -4.1% +17.5% ➖ noise
37 datafusion:vortex-file-compressed -2.6% +0.3% -2.8% +17.8% ➖ noise
37 duckdb:duckdb -4.2% +0.3% -4.4% +10.0% ➖ noise
37 duckdb:vortex-compact -7.9% +0.3% -8.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -2.5% +0.3% -2.7% +14.1% ➖ noise
38 datafusion:vortex-compact +4.9% -4.4% +9.8% +13.2% ➖ noise
38 datafusion:vortex-file-compressed -2.1% -4.4% +2.5% +10.0% ➖ noise
38 duckdb:duckdb +11.5% -4.4% +16.7% +16.6% 🚨 regression
38 duckdb:vortex-compact -9.0% -4.4% -4.8% +28.2% ➖ noise
38 duckdb:vortex-file-compressed -2.5% -4.4% +2.0% +10.0% ➖ noise
39 datafusion:vortex-compact -5.4% +0.0% -5.4% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -4.2% +0.0% -4.2% +10.0% ➖ noise
39 duckdb:duckdb -4.0% +0.0% -4.0% +10.0% ➖ noise
39 duckdb:vortex-compact -5.7% +0.0% -5.7% +13.3% ➖ noise
39 duckdb:vortex-file-compressed +2.2% +0.0% +2.2% +10.0% ➖ noise
40 datafusion:vortex-compact -2.1% +0.9% -3.0% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -5.7% +0.9% -6.5% +11.4% ➖ noise
40 duckdb:duckdb -2.4% +0.9% -3.2% +10.0% ➖ noise
40 duckdb:vortex-compact -4.3% +0.9% -5.1% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -0.5% +0.9% -1.4% +10.0% ➖ noise
41 datafusion:vortex-compact -3.4% -3.0% -0.4% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -4.9% -3.0% -1.9% +10.0% ➖ noise
41 duckdb:duckdb -1.1% -3.0% +2.0% +10.0% ➖ noise
41 duckdb:vortex-compact -4.5% -3.0% -1.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -2.4% -3.0% +0.6% +10.0% ➖ noise
42 datafusion:vortex-compact -3.0% +2.6% -5.5% +27.6% ➖ noise
42 datafusion:vortex-file-compressed -2.1% +2.6% -4.6% +10.0% ➖ noise
42 duckdb:duckdb +0.6% +2.6% -1.9% +15.7% ➖ noise
42 duckdb:vortex-compact -1.8% +2.6% -4.3% +19.7% ➖ noise
42 duckdb:vortex-file-compressed +1.6% +2.6% -1.0% +37.5% ➖ noise
43 datafusion:vortex-compact -5.3% -1.8% -3.6% +15.0% ➖ noise
43 datafusion:vortex-file-compressed -3.8% -1.8% -2.0% +10.0% ➖ noise
43 duckdb:duckdb -4.9% -1.8% -3.1% +11.4% ➖ noise
43 duckdb:vortex-compact +4.1% -1.8% +6.0% +20.9% ➖ noise
43 duckdb:vortex-file-compressed -2.1% -1.8% -0.3% +10.2% ➖ noise
44 datafusion:vortex-compact -2.4% -2.0% -0.5% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -3.3% -2.0% -1.4% +12.5% ➖ noise
44 duckdb:duckdb +0.5% -2.0% +2.5% +10.5% ➖ noise
44 duckdb:vortex-compact -0.9% -2.0% +1.1% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +1.7% -2.0% +3.7% +10.0% ➖ noise
45 datafusion:vortex-compact -1.3% +0.1% -1.4% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -0.5% +0.1% -0.6% +15.0% ➖ noise
45 duckdb:duckdb +0.0% +0.1% -0.1% +10.0% ➖ noise
45 duckdb:vortex-compact -3.6% +0.1% -3.7% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +2.6% +0.1% +2.5% +10.0% ➖ noise
46 datafusion:vortex-compact -1.8% -1.4% -0.4% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -1.4% -1.4% +0.0% +10.0% ➖ noise
46 duckdb:duckdb +1.1% -1.4% +2.5% +10.0% ➖ noise
46 duckdb:vortex-compact -3.9% -1.4% -2.5% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +6.9% -1.4% +8.4% +10.0% ➖ noise
47 datafusion:vortex-compact -2.3% +1.9% -4.1% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -3.1% +1.9% -4.9% +10.0% ➖ noise
47 duckdb:duckdb -2.1% +1.9% -3.9% +10.0% ➖ noise
47 duckdb:vortex-compact -0.5% +1.9% -2.4% +11.8% ➖ noise
47 duckdb:vortex-file-compressed -4.3% +1.9% -6.0% +10.0% ➖ noise
48 datafusion:vortex-compact +21.8% +0.3% +21.4% +15.3% 🚨 regression
48 datafusion:vortex-file-compressed +0.7% +0.3% +0.4% +11.1% ➖ noise
48 duckdb:duckdb +3.2% +0.3% +2.9% +12.2% ➖ noise
48 duckdb:vortex-compact -0.5% +0.3% -0.7% +16.9% ➖ noise
48 duckdb:vortex-file-compressed -7.2% +0.3% -7.5% +10.0% ➖ noise
49 datafusion:vortex-compact -4.5% -0.6% -4.0% +10.5% ➖ noise
49 datafusion:vortex-file-compressed +0.6% -0.6% +1.2% +10.0% ➖ noise
49 duckdb:duckdb +6.1% -0.6% +6.7% +10.0% ➖ noise
49 duckdb:vortex-compact -7.8% -0.6% -7.2% +10.0% ➖ noise
49 duckdb:vortex-file-compressed +5.3% -0.6% +5.9% +16.6% ➖ noise
50 datafusion:vortex-compact -0.6% +0.9% -1.5% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +1.2% +0.9% +0.2% +10.0% ➖ noise
50 duckdb:duckdb -2.7% +0.9% -3.6% +10.0% ➖ noise
50 duckdb:vortex-compact +3.0% +0.9% +2.0% +18.5% ➖ noise
50 duckdb:vortex-file-compressed +1.4% +0.9% +0.4% +10.0% ➖ noise
51 datafusion:vortex-compact -0.4% +2.3% -2.6% +12.1% ➖ noise
51 datafusion:vortex-file-compressed -1.0% +2.3% -3.2% +10.0% ➖ noise
51 duckdb:duckdb -1.4% +2.3% -3.6% +10.1% ➖ noise
51 duckdb:vortex-compact -2.6% +2.3% -4.8% +11.0% ➖ noise
51 duckdb:vortex-file-compressed -1.5% +2.3% -3.7% +22.5% ➖ noise
52 datafusion:vortex-compact -0.2% -2.2% +2.0% +12.6% ➖ noise
52 datafusion:vortex-file-compressed +8.2% -2.2% +10.7% +17.6% ➖ noise
52 duckdb:duckdb +5.6% -2.2% +8.0% +16.4% ➖ noise
52 duckdb:vortex-compact +0.8% -2.2% +3.1% +21.0% ➖ noise
52 duckdb:vortex-file-compressed +2.2% -2.2% +4.6% +12.8% ➖ noise
53 datafusion:vortex-compact -2.2% +2.3% -4.4% +14.4% ➖ noise
53 datafusion:vortex-file-compressed -4.9% +2.3% -7.0% +12.1% ➖ noise
53 duckdb:duckdb +3.1% +2.3% +0.8% +10.0% ➖ noise
53 duckdb:vortex-compact -0.1% +2.3% -2.3% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -2.9% +2.3% -5.0% +10.0% ➖ noise
54 datafusion:vortex-compact -1.6% -2.3% +0.7% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -4.8% -2.3% -2.6% +10.4% ➖ noise
54 duckdb:duckdb -0.7% -2.3% +1.7% +10.0% ➖ noise
54 duckdb:vortex-compact -2.9% -2.3% -0.6% +17.4% ➖ noise
54 duckdb:vortex-file-compressed -5.8% -2.3% -3.6% +10.0% ➖ noise
55 datafusion:vortex-compact -1.2% -0.3% -0.9% +12.1% ➖ noise
55 datafusion:vortex-file-compressed -3.4% -0.3% -3.1% +13.6% ➖ noise
55 duckdb:duckdb +5.4% -0.3% +5.7% +22.0% ➖ noise
55 duckdb:vortex-compact -6.1% -0.3% -5.9% +14.8% ➖ noise
55 duckdb:vortex-file-compressed -5.3% -0.3% -5.1% +13.0% ➖ noise
56 datafusion:vortex-compact -0.0% -3.3% +3.4% +17.6% ➖ noise
56 datafusion:vortex-file-compressed -5.7% -3.3% -2.5% +12.0% ➖ noise
56 duckdb:duckdb +0.9% -3.3% +4.3% +10.0% ➖ noise
56 duckdb:vortex-compact +0.1% -3.3% +3.5% +24.4% ➖ noise
56 duckdb:vortex-file-compressed -2.5% -3.3% +0.8% +26.0% ➖ noise
57 datafusion:vortex-compact -2.4% -1.9% -0.4% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +1.1% -1.9% +3.1% +10.0% ➖ noise
57 duckdb:duckdb -0.2% -1.9% +1.8% +10.0% ➖ noise
57 duckdb:vortex-compact -2.7% -1.9% -0.7% +10.1% ➖ noise
57 duckdb:vortex-file-compressed -2.9% -1.9% -1.0% +18.5% ➖ noise
58 datafusion:vortex-compact +0.6% +0.6% +0.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -6.5% +0.6% -7.0% +10.0% ➖ noise
58 duckdb:duckdb +4.7% +0.6% +4.1% +10.5% ➖ noise
58 duckdb:vortex-compact -1.0% +0.6% -1.5% +14.2% ➖ noise
58 duckdb:vortex-file-compressed -2.1% +0.6% -2.6% +21.9% ➖ noise
59 datafusion:vortex-compact -5.8% -1.9% -3.9% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -5.3% -1.9% -3.5% +10.0% ➖ noise
59 duckdb:duckdb -1.9% -1.9% +0.0% +10.0% ➖ noise
59 duckdb:vortex-compact -5.3% -1.9% -3.5% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -2.7% -1.9% -0.7% +38.3% ➖ noise
60 datafusion:vortex-compact -0.8% -3.0% +2.3% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -0.9% -3.0% +2.2% +13.2% ➖ noise
60 duckdb:duckdb +5.4% -3.0% +8.7% +10.0% ➖ noise
60 duckdb:vortex-compact +3.2% -3.0% +6.4% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +1.9% -3.0% +5.1% +11.4% ➖ noise
61 datafusion:vortex-compact -0.5% -4.0% +3.6% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -2.0% -4.0% +2.1% +11.8% ➖ noise
61 duckdb:duckdb +0.1% -4.0% +4.2% +10.6% ➖ noise
61 duckdb:vortex-compact -0.1% -4.0% +4.0% +14.4% ➖ noise
61 duckdb:vortex-file-compressed -2.4% -4.0% +1.6% +10.0% ➖ noise
62 datafusion:vortex-compact +33.3% -6.6% +42.8% +34.5% 🚨 regression
62 datafusion:vortex-file-compressed -12.6% -6.6% -6.4% +29.1% ➖ noise
62 duckdb:duckdb -1.4% -6.6% +5.6% +24.1% ➖ noise
62 duckdb:vortex-compact -1.2% -6.6% +5.8% +20.2% ➖ noise
62 duckdb:vortex-file-compressed -7.6% -6.6% -1.0% +28.4% ➖ noise
63 datafusion:vortex-compact -1.7% -2.4% +0.8% +12.4% ➖ noise
63 datafusion:vortex-file-compressed -2.2% -2.4% +0.2% +10.0% ➖ noise
63 duckdb:duckdb -2.5% -2.4% -0.0% +10.0% ➖ noise
63 duckdb:vortex-compact -4.2% -2.4% -1.8% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -8.7% -2.4% -6.4% +10.0% ➖ noise
64 datafusion:vortex-compact -1.4% +1.8% -3.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -3.3% +1.8% -5.0% +10.0% ➖ noise
64 duckdb:duckdb -0.5% +1.8% -2.3% +10.0% ➖ noise
64 duckdb:vortex-compact -5.0% +1.8% -6.7% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +1.5% +1.8% -0.4% +10.0% ➖ noise
65 datafusion:vortex-compact -1.1% -1.9% +0.8% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -2.1% -1.9% -0.2% +21.0% ➖ noise
65 duckdb:duckdb -0.7% -1.9% +1.2% +10.0% ➖ noise
65 duckdb:vortex-compact -0.7% -1.9% +1.2% +10.6% ➖ noise
65 duckdb:vortex-file-compressed -5.0% -1.9% -3.1% +10.2% ➖ noise
66 datafusion:vortex-compact -1.6% +2.5% -4.0% +20.4% ➖ noise
66 datafusion:vortex-file-compressed -5.0% +2.5% -7.3% +11.3% ➖ noise
66 duckdb:duckdb -2.1% +2.5% -4.5% +12.0% ➖ noise
66 duckdb:vortex-compact -3.2% +2.5% -5.6% +11.5% ➖ noise
66 duckdb:vortex-file-compressed -3.8% +2.5% -6.1% +13.0% ➖ noise
67 datafusion:vortex-compact +5.1% -1.5% +6.7% +12.6% ➖ noise
67 datafusion:vortex-file-compressed -1.2% -1.5% +0.3% +11.2% ➖ noise
67 duckdb:duckdb -0.8% -1.5% +0.8% +10.0% ➖ noise
67 duckdb:vortex-compact -2.8% -1.5% -1.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -1.3% -1.5% +0.2% +10.0% ➖ noise
68 datafusion:vortex-compact +1.0% -0.4% +1.4% +24.1% ➖ noise
68 datafusion:vortex-file-compressed -1.2% -0.4% -0.8% +15.9% ➖ noise
68 duckdb:duckdb +4.2% -0.4% +4.7% +10.0% ➖ noise
68 duckdb:vortex-compact -6.5% -0.4% -6.1% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -4.1% -0.4% -3.7% +12.5% ➖ noise
69 datafusion:vortex-compact -6.1% +3.9% -9.7% +11.1% ➖ noise
69 datafusion:vortex-file-compressed -7.1% +3.9% -10.6% +10.0% ✅ faster
69 duckdb:duckdb -0.3% +3.9% -4.0% +10.0% ➖ noise
69 duckdb:vortex-compact -2.6% +3.9% -6.3% +13.8% ➖ noise
69 duckdb:vortex-file-compressed -0.5% +3.9% -4.3% +24.0% ➖ noise
70 datafusion:vortex-compact +2.2% -3.8% +6.2% +13.6% ➖ noise
70 datafusion:vortex-file-compressed -4.9% -3.8% -1.2% +16.5% ➖ noise
70 duckdb:duckdb +0.7% -3.8% +4.6% +13.7% ➖ noise
70 duckdb:vortex-compact -0.6% -3.8% +3.3% +17.0% ➖ noise
70 duckdb:vortex-file-compressed +2.3% -3.8% +6.4% +12.8% ➖ noise
71 datafusion:vortex-compact -5.8% -2.4% -3.5% +22.1% ➖ noise
71 datafusion:vortex-file-compressed -2.2% -2.4% +0.2% +10.0% ➖ noise
71 duckdb:duckdb +1.3% -2.4% +3.7% +10.0% ➖ noise
71 duckdb:vortex-compact -9.6% -2.4% -7.4% +12.3% ➖ noise
71 duckdb:vortex-file-compressed -7.5% -2.4% -5.3% +18.0% ➖ noise
72 datafusion:vortex-compact -0.3% -0.6% +0.2% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -1.6% -0.6% -1.1% +10.0% ➖ noise
72 duckdb:duckdb -1.6% -0.6% -1.0% +10.0% ➖ noise
72 duckdb:vortex-compact +1.1% -0.6% +1.7% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.3% -0.6% +0.9% +10.0% ➖ noise
73 datafusion:vortex-compact -0.3% +2.6% -2.8% +24.3% ➖ noise
73 datafusion:vortex-file-compressed -1.7% +2.6% -4.2% +20.4% ➖ noise
73 duckdb:duckdb +9.5% +2.6% +6.7% +18.7% ➖ noise
73 duckdb:vortex-compact -2.4% +2.6% -4.8% +14.6% ➖ noise
73 duckdb:vortex-file-compressed -4.6% +2.6% -7.0% +16.8% ➖ noise
74 datafusion:vortex-compact -6.4% -0.8% -5.6% +18.3% ➖ noise
74 datafusion:vortex-file-compressed -2.5% -0.8% -1.7% +10.8% ➖ noise
74 duckdb:duckdb +1.4% -0.8% +2.2% +10.0% ➖ noise
74 duckdb:vortex-compact -2.8% -0.8% -2.0% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +0.4% -0.8% +1.2% +12.2% ➖ noise
75 datafusion:vortex-compact -4.7% -2.5% -2.2% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +1.3% -2.5% +4.0% +13.5% ➖ noise
75 duckdb:duckdb -3.0% -2.5% -0.5% +10.0% ➖ noise
75 duckdb:vortex-compact -1.6% -2.5% +0.9% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -1.6% -2.5% +1.0% +11.2% ➖ noise
76 datafusion:vortex-compact +0.1% +4.0% -3.7% +20.4% ➖ noise
76 datafusion:vortex-file-compressed +4.4% +4.0% +0.4% +10.0% ➖ noise
76 duckdb:duckdb +0.4% +4.0% -3.4% +10.0% ➖ noise
76 duckdb:vortex-compact -12.3% +4.0% -15.6% +13.2% ✅ faster
76 duckdb:vortex-file-compressed +0.2% +4.0% -3.6% +10.0% ➖ noise
77 datafusion:vortex-compact -3.3% +0.2% -3.5% +14.3% ➖ noise
77 datafusion:vortex-file-compressed -7.8% +0.2% -8.0% +10.0% ➖ noise
77 duckdb:duckdb -2.7% +0.2% -2.9% +10.0% ➖ noise
77 duckdb:vortex-compact +4.0% +0.2% +3.8% +20.7% ➖ noise
77 duckdb:vortex-file-compressed -5.8% +0.2% -6.0% +15.6% ➖ noise
78 datafusion:vortex-compact -4.5% -1.0% -3.6% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +0.9% -1.0% +1.9% +10.0% ➖ noise
78 duckdb:duckdb -1.8% -1.0% -0.8% +10.0% ➖ noise
78 duckdb:vortex-compact -0.1% -1.0% +0.9% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -0.7% -1.0% +0.3% +13.6% ➖ noise
79 datafusion:vortex-compact -1.7% -2.7% +0.9% +10.3% ➖ noise
79 datafusion:vortex-file-compressed -3.6% -2.7% -0.9% +14.4% ➖ noise
79 duckdb:duckdb +3.3% -2.7% +6.1% +18.7% ➖ noise
79 duckdb:vortex-compact -4.9% -2.7% -2.3% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -6.1% -2.7% -3.5% +10.0% ➖ noise
80 datafusion:vortex-compact -5.8% -4.4% -1.4% +10.4% ➖ noise
80 datafusion:vortex-file-compressed -4.1% -4.4% +0.4% +12.4% ➖ noise
80 duckdb:duckdb -12.9% -4.4% -8.8% +10.0% ➖ noise
80 duckdb:vortex-compact +0.6% -4.4% +5.2% +11.3% ➖ noise
80 duckdb:vortex-file-compressed -4.0% -4.4% +0.4% +10.0% ➖ noise
81 datafusion:vortex-compact -11.6% -1.7% -10.1% +28.4% ➖ noise
81 datafusion:vortex-file-compressed +1.5% -1.7% +3.2% +13.4% ➖ noise
81 duckdb:duckdb +2.6% -1.7% +4.3% +10.0% ➖ noise
81 duckdb:vortex-compact -5.9% -1.7% -4.3% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -0.0% -1.7% +1.7% +27.2% ➖ noise
82 datafusion:vortex-compact -0.3% -2.7% +2.5% +14.2% ➖ noise
82 datafusion:vortex-file-compressed -6.9% -2.7% -4.2% +23.0% ➖ noise
82 duckdb:duckdb -9.6% -2.7% -7.0% +14.6% ➖ noise
82 duckdb:vortex-compact -5.2% -2.7% -2.5% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -0.7% -2.7% +2.1% +11.3% ➖ noise
83 datafusion:vortex-compact -3.1% +0.1% -3.1% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -1.2% +0.1% -1.3% +10.5% ➖ noise
83 duckdb:duckdb -3.6% +0.1% -3.7% +10.0% ➖ noise
83 duckdb:vortex-compact +0.3% +0.1% +0.2% +19.5% ➖ noise
83 duckdb:vortex-file-compressed -7.4% +0.1% -7.5% +10.0% ➖ noise
84 datafusion:vortex-compact -5.5% +1.8% -7.1% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -5.5% +1.8% -7.2% +10.7% ➖ noise
84 duckdb:duckdb -2.7% +1.8% -4.4% +10.0% ➖ noise
84 duckdb:vortex-compact -4.8% +1.8% -6.5% +15.5% ➖ noise
84 duckdb:vortex-file-compressed -3.4% +1.8% -5.1% +10.0% ➖ noise
85 datafusion:vortex-compact -3.4% +0.0% -3.4% +12.7% ➖ noise
85 datafusion:vortex-file-compressed -1.0% +0.0% -1.0% +10.0% ➖ noise
85 duckdb:duckdb +3.6% +0.0% +3.5% +10.0% ➖ noise
85 duckdb:vortex-compact -5.9% +0.0% -6.0% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -6.6% +0.0% -6.7% +10.0% ➖ noise
86 datafusion:vortex-compact +17.2% +0.1% +17.1% +21.8% ➖ noise
86 datafusion:vortex-file-compressed +5.1% +0.1% +5.0% +21.3% ➖ noise
86 duckdb:duckdb -3.0% +0.1% -3.2% +10.4% ➖ noise
86 duckdb:vortex-compact -2.3% +0.1% -2.4% +23.9% ➖ noise
86 duckdb:vortex-file-compressed -0.4% +0.1% -0.5% +27.5% ➖ noise
87 datafusion:vortex-compact -5.2% -1.9% -3.4% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -3.5% -1.9% -1.7% +10.0% ➖ noise
87 duckdb:duckdb -1.1% -1.9% +0.8% +14.8% ➖ noise
87 duckdb:vortex-compact -5.2% -1.9% -3.4% +15.1% ➖ noise
87 duckdb:vortex-file-compressed -2.9% -1.9% -1.1% +10.0% ➖ noise
88 datafusion:vortex-compact -1.1% -0.3% -0.8% +10.9% ➖ noise
88 datafusion:vortex-file-compressed -1.4% -0.3% -1.1% +10.0% ➖ noise
88 duckdb:duckdb -0.1% -0.3% +0.2% +10.0% ➖ noise
88 duckdb:vortex-compact -3.3% -0.3% -3.0% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -3.2% -0.3% -2.9% +10.3% ➖ noise
89 datafusion:vortex-compact +1.3% +0.6% +0.6% +10.9% ➖ noise
89 datafusion:vortex-file-compressed -7.1% +0.6% -7.6% +12.3% ➖ noise
89 duckdb:duckdb -2.6% +0.6% -3.2% +10.0% ➖ noise
89 duckdb:vortex-compact -1.0% +0.6% -1.6% +21.5% ➖ noise
89 duckdb:vortex-file-compressed +1.0% +0.6% +0.4% +10.0% ➖ noise
90 datafusion:vortex-compact -0.3% -2.9% +2.7% +13.4% ➖ noise
90 datafusion:vortex-file-compressed +3.6% -2.9% +6.7% +38.4% ➖ noise
90 duckdb:duckdb -6.4% -2.9% -3.6% +10.0% ➖ noise
90 duckdb:vortex-compact -5.7% -2.9% -2.8% +11.7% ➖ noise
90 duckdb:vortex-file-compressed -9.2% -2.9% -6.5% +26.1% ➖ noise
91 datafusion:vortex-compact -10.0% +2.3% -12.0% +10.0% ✅ faster
91 datafusion:vortex-file-compressed +5.1% +2.3% +2.8% +11.5% ➖ noise
91 duckdb:duckdb -1.0% +2.3% -3.2% +10.0% ➖ noise
91 duckdb:vortex-compact -5.1% +2.3% -7.2% +11.2% ➖ noise
91 duckdb:vortex-file-compressed -10.3% +2.3% -12.3% +10.0% ✅ faster
92 datafusion:vortex-compact -13.6% -0.4% -13.2% +12.3% ✅ faster
92 datafusion:vortex-file-compressed +0.5% -0.4% +0.9% +14.4% ➖ noise
92 duckdb:duckdb -3.7% -0.4% -3.3% +10.1% ➖ noise
92 duckdb:vortex-compact +7.4% -0.4% +7.9% +15.0% ➖ noise
92 duckdb:vortex-file-compressed -10.3% -0.4% -9.9% +16.2% ➖ noise
93 datafusion:vortex-compact -4.9% -2.7% -2.2% +13.2% ➖ noise
93 datafusion:vortex-file-compressed -3.3% -2.7% -0.5% +12.9% ➖ noise
93 duckdb:duckdb -1.4% -2.7% +1.4% +10.0% ➖ noise
93 duckdb:vortex-compact -4.6% -2.7% -1.9% +15.8% ➖ noise
93 duckdb:vortex-file-compressed -7.0% -2.7% -4.3% +10.0% ➖ noise
94 datafusion:vortex-compact -6.5% -0.4% -6.2% +24.7% ➖ noise
94 datafusion:vortex-file-compressed +0.9% -0.4% +1.2% +10.0% ➖ noise
94 duckdb:duckdb +4.4% -0.4% +4.8% +10.0% ➖ noise
94 duckdb:vortex-compact +0.2% -0.4% +0.6% +13.0% ➖ noise
94 duckdb:vortex-file-compressed +0.7% -0.4% +1.0% +11.3% ➖ noise
95 datafusion:vortex-compact -1.5% -0.5% -1.1% +13.8% ➖ noise
95 datafusion:vortex-file-compressed -5.1% -0.5% -4.7% +11.1% ➖ noise
95 duckdb:duckdb -14.6% -0.5% -14.1% +15.6% ✅ faster
95 duckdb:vortex-compact -3.8% -0.5% -3.4% +16.1% ➖ noise
95 duckdb:vortex-file-compressed -5.9% -0.5% -5.5% +17.2% ➖ noise
96 datafusion:vortex-compact -4.0% +2.6% -6.4% +17.5% ➖ noise
96 datafusion:vortex-file-compressed -10.6% +2.6% -12.8% +12.6% ✅ faster
96 duckdb:duckdb -2.0% +2.6% -4.4% +15.3% ➖ noise
96 duckdb:vortex-compact -4.2% +2.6% -6.6% +12.5% ➖ noise
96 duckdb:vortex-file-compressed +4.3% +2.6% +1.6% +16.5% ➖ noise
97 datafusion:vortex-compact -0.6% -3.6% +3.1% +10.2% ➖ noise
97 datafusion:vortex-file-compressed +3.0% -3.6% +6.9% +18.8% ➖ noise
97 duckdb:duckdb -2.8% -3.6% +0.8% +10.0% ➖ noise
97 duckdb:vortex-compact -2.2% -3.6% +1.5% +10.0% ➖ noise
97 duckdb:vortex-file-compressed -4.9% -3.6% -1.3% +10.0% ➖ noise
98 datafusion:vortex-compact -2.4% -2.1% -0.3% +11.7% ➖ noise
98 datafusion:vortex-file-compressed -1.5% -2.1% +0.6% +14.7% ➖ noise
98 duckdb:duckdb +0.6% -2.1% +2.7% +10.0% ➖ noise
98 duckdb:vortex-compact -3.0% -2.1% -0.9% +13.4% ➖ noise
98 duckdb:vortex-file-compressed -1.5% -2.1% +0.6% +10.0% ➖ noise
99 datafusion:vortex-compact -3.5% -8.5% +5.5% +39.7% ➖ noise
99 datafusion:vortex-file-compressed -2.2% -8.5% +6.9% +32.4% ➖ noise
99 duckdb:duckdb -1.4% -8.5% +7.8% +21.9% ➖ noise
99 duckdb:vortex-compact -9.1% -8.5% -0.6% +30.3% ➖ noise
99 duckdb:vortex-file-compressed -4.1% -8.5% +4.8% +19.5% ➖ noise

@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.2%
Engines: DataFusion No clear signal (+5.1%, environment too noisy confidence) · DuckDB No clear signal (+1.3%, environment too noisy confidence)
Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.953x ➖
Shifts: Parquet (control) -4.7% · Median polish -3.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.936x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36048427 48808948 0.74
fineweb_q01/datafusion:vortex-file-compressed 555589161 598717832 0.93
fineweb_q02/datafusion:vortex-file-compressed 722976137 580819254 1.24
fineweb_q03/datafusion:vortex-file-compressed 1107561908 1209502324 0.92
fineweb_q04/datafusion:vortex-file-compressed 1198413779 1200207593 1.00
fineweb_q05/datafusion:vortex-file-compressed 1064273185 1145500683 0.93
fineweb_q06/datafusion:vortex-file-compressed 1318154889 1298626487 1.02
fineweb_q07/datafusion:vortex-file-compressed 1068237138 1182022834 0.90
fineweb_q08/datafusion:vortex-file-compressed 415778958 500151386 0.83
datafusion / vortex-compact (1.031x ➖, 0↑ 1↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 45096003 34530647 1.31
fineweb_q01/datafusion:vortex-compact 686474531 593414280 1.16
fineweb_q02/datafusion:vortex-compact 601249927 631183692 0.95
fineweb_q03/datafusion:vortex-compact 1379677666 1398131677 0.99
fineweb_q04/datafusion:vortex-compact 1596534727 1577941246 1.01
fineweb_q05/datafusion:vortex-compact 1365363743 1394590632 0.98
fineweb_q06/datafusion:vortex-compact 1267592346 1303129443 0.97
fineweb_q07/datafusion:vortex-compact 1208522806 1181391282 1.02
fineweb_q08/datafusion:vortex-compact 372204264 396744388 0.94
datafusion / parquet (0.934x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1337607021 1420731277 0.94
fineweb_q01/datafusion:parquet 1935181514 2118609011 0.91
fineweb_q02/datafusion:parquet 2044357101 2200614726 0.93
fineweb_q03/datafusion:parquet 2248174428 2202132970 1.02
fineweb_q04/datafusion:parquet 2225803737 2256712115 0.99
fineweb_q05/datafusion:parquet 2020254045 2130926788 0.95
fineweb_q06/datafusion:parquet 2027152531 2232895523 0.91
fineweb_q07/datafusion:parquet 1888170864 2303555471 0.82
fineweb_q08/datafusion:parquet 2152414295 2251030332 0.96
duckdb / vortex-file-compressed (0.960x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 83806303 75343362 1.11
fineweb_q01/duckdb:vortex-file-compressed 539227853 606573505 0.89
fineweb_q02/duckdb:vortex-file-compressed 571734524 693509824 0.82
fineweb_q03/duckdb:vortex-file-compressed 1380899570 1444620626 0.96
fineweb_q04/duckdb:vortex-file-compressed 1412350452 1431932989 0.99
fineweb_q05/duckdb:vortex-file-compressed 1503068221 1481490322 1.01
fineweb_q06/duckdb:vortex-file-compressed 1691144744 1580838117 1.07
fineweb_q07/duckdb:vortex-file-compressed 1214618049 1470142178 0.83
fineweb_q08/duckdb:vortex-file-compressed 573650140 571521373 1.00
duckdb / vortex-compact (1.009x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 80673287 62684460 1.29
fineweb_q01/duckdb:vortex-compact 567031017 651189479 0.87
fineweb_q02/duckdb:vortex-compact 607585621 686089090 0.89
fineweb_q03/duckdb:vortex-compact 1683509721 1773980115 0.95
fineweb_q04/duckdb:vortex-compact 1915648811 1809354704 1.06
fineweb_q05/duckdb:vortex-compact 1598508903 1571974715 1.02
fineweb_q06/duckdb:vortex-compact 1560673221 1551683561 1.01
fineweb_q07/duckdb:vortex-compact 1465194398 1400365501 1.05
fineweb_q08/duckdb:vortex-compact 538962952 529336130 1.02
duckdb / parquet (0.972x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1225190874 1334492782 0.92
fineweb_q01/duckdb:parquet 1508740673 1431910469 1.05
fineweb_q02/duckdb:parquet 1355024914 1484994527 0.91
fineweb_q03/duckdb:parquet 4133234989 4013631582 1.03
fineweb_q04/duckdb:parquet 1966001436 2027564499 0.97
fineweb_q05/duckdb:parquet 2388659630 2440914697 0.98
fineweb_q06/duckdb:parquet 4375508170 4724397029 0.93
fineweb_q07/duckdb:parquet 2860336499 2922273226 0.98
fineweb_q08/duckdb:parquet 1146476413 1161407436 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +30.6% -7.0% +40.5% +188.0% ➖ noise
0 datafusion:vortex-file-compressed -26.1% -7.0% -20.6% +183.4% ➖ noise
0 duckdb:vortex-compact +28.7% -7.0% +38.4% +45.2% ➖ noise
0 duckdb:vortex-file-compressed +11.2% -7.0% +19.6% +101.0% ➖ noise
1 datafusion:vortex-compact +15.7% -1.9% +17.9% +70.7% ➖ noise
1 datafusion:vortex-file-compressed -7.2% -1.9% -5.4% +74.1% ➖ noise
1 duckdb:vortex-compact -12.9% -1.9% -11.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -11.1% -1.9% -9.4% +30.0% ➖ noise
2 datafusion:vortex-compact -4.7% -7.9% +3.5% +45.0% ➖ noise
2 datafusion:vortex-file-compressed +24.5% -7.9% +35.2% +54.3% ➖ noise
2 duckdb:vortex-compact -11.4% -7.9% -3.8% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -17.6% -7.9% -10.5% +34.3% ➖ noise
3 datafusion:vortex-compact -1.3% +2.5% -3.8% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -8.4% +2.5% -10.7% +30.0% ➖ noise
3 duckdb:vortex-compact -5.1% +2.5% -7.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -4.4% +2.5% -6.8% +30.0% ➖ noise
4 datafusion:vortex-compact +1.2% -2.2% +3.5% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% -2.2% +2.1% +30.0% ➖ noise
4 duckdb:vortex-compact +5.9% -2.2% +8.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -1.4% -2.2% +0.9% +30.0% ➖ noise
5 datafusion:vortex-compact -2.1% -3.7% +1.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -7.1% -3.7% -3.5% +30.0% ➖ noise
5 duckdb:vortex-compact +1.7% -3.7% +5.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +1.5% -3.7% +5.3% +30.0% ➖ noise
6 datafusion:vortex-compact -2.7% -8.3% +6.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +1.5% -8.3% +10.7% +30.0% ➖ noise
6 duckdb:vortex-compact +0.6% -8.3% +9.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +7.0% -8.3% +16.7% +30.0% ➖ noise
7 datafusion:vortex-compact +2.3% -10.4% +14.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -9.6% -10.4% +0.9% +30.0% ➖ noise
7 duckdb:vortex-compact +4.6% -10.4% +16.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -17.4% -10.4% -7.8% +30.0% ➖ noise
8 datafusion:vortex-compact -6.2% -2.8% -3.4% +33.3% ➖ noise
8 datafusion:vortex-file-compressed -16.9% -2.8% -14.4% +30.0% ➖ noise
8 duckdb:vortex-compact +1.8% -2.8% +4.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +0.4% -2.8% +3.3% +30.0% ➖ noise

@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Engines: DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.964x ➖
Shifts: Parquet (control) -3.6% · Median polish -3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.969x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12520088 13033995 0.96
statpopgen_q01/duckdb:vortex-file-compressed 27369545 29212390 0.94
statpopgen_q02/duckdb:vortex-file-compressed 548491389 583606075 0.94
statpopgen_q03/duckdb:vortex-file-compressed 1067284250 1109558368 0.96
statpopgen_q04/duckdb:vortex-file-compressed 1075204769 1090746614 0.99
statpopgen_q05/duckdb:vortex-file-compressed 512101306 526786442 0.97
statpopgen_q06/duckdb:vortex-file-compressed 1557077130 1571359264 0.99
statpopgen_q07/duckdb:vortex-file-compressed 209593534 218913531 0.96
statpopgen_q08/duckdb:vortex-file-compressed 247045728 250254016 0.99
statpopgen_q09/duckdb:vortex-file-compressed 860996569 868626516 0.99
statpopgen_q10/duckdb:vortex-file-compressed 2635106782 2702220817 0.98
duckdb / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12404294 12318869 1.01
statpopgen_q01/duckdb:vortex-compact 253320765 234213198 1.08
statpopgen_q02/duckdb:vortex-compact 570981463 571966014 1.00
statpopgen_q03/duckdb:vortex-compact 1151621776 1172131279 0.98
statpopgen_q04/duckdb:vortex-compact 1175768332 1170051933 1.00
statpopgen_q05/duckdb:vortex-compact 574676594 579092869 0.99
statpopgen_q06/duckdb:vortex-compact 1513952411 1519303658 1.00
statpopgen_q07/duckdb:vortex-compact 898856525 911959505 0.99
statpopgen_q08/duckdb:vortex-compact 935192513 953377658 0.98
statpopgen_q09/duckdb:vortex-compact 928958748 963477985 0.96
statpopgen_q10/duckdb:vortex-compact 2612418834 2686324314 0.97
duckdb / parquet (0.964x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 303762327 315203118 0.96
statpopgen_q01/duckdb:parquet 390357252 390895262 1.00
statpopgen_q02/duckdb:parquet 764312525 811434232 0.94
statpopgen_q03/duckdb:parquet 1194932782 1259204817 0.95
statpopgen_q04/duckdb:parquet 1212397867 1266680546 0.96
statpopgen_q05/duckdb:parquet 816447480 845673495 0.97
statpopgen_q06/duckdb:parquet 1427839724 1462011816 0.98
statpopgen_q07/duckdb:parquet 865349708 892393852 0.97
statpopgen_q08/duckdb:parquet 868055266 907092267 0.96
statpopgen_q09/duckdb:parquet 1033374541 1060193165 0.97
statpopgen_q10/duckdb:parquet 2224039459 2336163066 0.95
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 102.28 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +0.7% -3.6% +4.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -3.9% -3.6% -0.3% +10.0% ➖ noise
1 duckdb:vortex-compact +8.2% -0.1% +8.3% +25.2% ➖ noise
1 duckdb:vortex-file-compressed -6.3% -0.1% -6.2% +219.5% ➖ noise
2 duckdb:vortex-compact -0.2% -5.8% +6.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -6.0% -5.8% -0.2% +10.0% ➖ noise
3 duckdb:vortex-compact -1.7% -5.1% +3.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.8% -5.1% +1.4% +10.0% ➖ noise
4 duckdb:vortex-compact +0.5% -4.3% +5.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.4% -4.3% +3.0% +10.0% ➖ noise
5 duckdb:vortex-compact -0.8% -3.5% +2.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.8% -3.5% +0.7% +10.0% ➖ noise
6 duckdb:vortex-compact -0.4% -2.3% +2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.9% -2.3% +1.5% +10.0% ➖ noise
7 duckdb:vortex-compact -1.4% -3.0% +1.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.3% -3.0% -1.3% +10.0% ➖ noise
8 duckdb:vortex-compact -1.9% -4.3% +2.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.3% -4.3% +3.2% +10.0% ➖ noise
9 duckdb:vortex-compact -3.6% -2.5% -1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.9% -2.5% +1.7% +10.0% ➖ noise
10 duckdb:vortex-compact -2.8% -4.8% +2.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.5% -4.8% +2.4% +10.0% ➖ noise

@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-1.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.025x ➖
Shifts: Parquet (control) +2.5% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.044x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 400952135 392781674 1.02
tpch_q02/datafusion:vortex-file-compressed 118966495 112844182 1.05
tpch_q03/datafusion:vortex-file-compressed 226532323 213176599 1.06
tpch_q04/datafusion:vortex-file-compressed 124106626 113902121 1.09
tpch_q05/datafusion:vortex-file-compressed 403332450 383270385 1.05
tpch_q06/datafusion:vortex-file-compressed 39375883 39273123 1.00
tpch_q07/datafusion:vortex-file-compressed 542419426 510590265 1.06
tpch_q08/datafusion:vortex-file-compressed 399277413 373325159 1.07
tpch_q09/datafusion:vortex-file-compressed 694662476 653562229 1.06
tpch_q10/datafusion:vortex-file-compressed 245329112 232207661 1.06
tpch_q11/datafusion:vortex-file-compressed 91630619 88782945 1.03
tpch_q12/datafusion:vortex-file-compressed 126986734 118795226 1.07
tpch_q13/datafusion:vortex-file-compressed 229608393 223487677 1.03
tpch_q14/datafusion:vortex-file-compressed 55999070 53838417 1.04
tpch_q15/datafusion:vortex-file-compressed 103779578 99960317 1.04
tpch_q16/datafusion:vortex-file-compressed 82699066 78638704 1.05
tpch_q17/datafusion:vortex-file-compressed 679415393 648717645 1.05
tpch_q18/datafusion:vortex-file-compressed 911518518 872242076 1.05
tpch_q19/datafusion:vortex-file-compressed 80239581 74367094 1.08
tpch_q20/datafusion:vortex-file-compressed 169670912 166764659 1.02
tpch_q21/datafusion:vortex-file-compressed 695927195 670852002 1.04
tpch_q22/datafusion:vortex-file-compressed 68999006 71277673 0.97
datafusion / vortex-compact (1.015x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 452865252 439186872 1.03
tpch_q02/datafusion:vortex-compact 120762137 115755186 1.04
tpch_q03/datafusion:vortex-compact 226644631 214271368 1.06
tpch_q04/datafusion:vortex-compact 126097213 120458225 1.05
tpch_q05/datafusion:vortex-compact 397732961 386690596 1.03
tpch_q06/datafusion:vortex-compact 62460527 60115128 1.04
tpch_q07/datafusion:vortex-compact 559276118 535956729 1.04
tpch_q08/datafusion:vortex-compact 393647854 384769162 1.02
tpch_q09/datafusion:vortex-compact 680746964 671233210 1.01
tpch_q10/datafusion:vortex-compact 254266099 248389125 1.02
tpch_q11/datafusion:vortex-compact 90023177 90200287 1.00
tpch_q12/datafusion:vortex-compact 165017795 161628447 1.02
tpch_q13/datafusion:vortex-compact 272381724 266129641 1.02
tpch_q14/datafusion:vortex-compact 70250224 70461439 1.00
tpch_q15/datafusion:vortex-compact 158342820 156849859 1.01
tpch_q16/datafusion:vortex-compact 82456839 81882001 1.01
tpch_q17/datafusion:vortex-compact 654287593 656340263 1.00
tpch_q18/datafusion:vortex-compact 871069789 887107194 0.98
tpch_q19/datafusion:vortex-compact 126242659 125102680 1.01
tpch_q20/datafusion:vortex-compact 190062764 188663714 1.01
tpch_q21/datafusion:vortex-compact 675293279 680141099 0.99
tpch_q22/datafusion:vortex-compact 73659792 77612979 0.95
datafusion / parquet (1.045x ➖, 0↑ 1↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 468914885 438760015 1.07
tpch_q02/datafusion:parquet 187585681 175178085 1.07
tpch_q03/datafusion:parquet 🚨 317580473 284830122 1.11
tpch_q04/datafusion:parquet 136655101 129942976 1.05
tpch_q05/datafusion:parquet 479955839 446320718 1.08
tpch_q06/datafusion:parquet 129790941 127047944 1.02
tpch_q07/datafusion:parquet 663737620 619286635 1.07
tpch_q08/datafusion:parquet 506623724 471062244 1.08
tpch_q09/datafusion:parquet 795919515 767733584 1.04
tpch_q10/datafusion:parquet 515564602 512949447 1.01
tpch_q11/datafusion:parquet 122025185 119536263 1.02
tpch_q12/datafusion:parquet 207922559 201553930 1.03
tpch_q13/datafusion:parquet 339402024 341457747 0.99
tpch_q14/datafusion:parquet 155676155 162830728 0.96
tpch_q15/datafusion:parquet 286921299 267230439 1.07
tpch_q16/datafusion:parquet 136948118 126360689 1.08
tpch_q17/datafusion:parquet 733722915 705556765 1.04
tpch_q18/datafusion:parquet 965943581 922973497 1.05
tpch_q19/datafusion:parquet 259180163 254330634 1.02
tpch_q20/datafusion:parquet 315437507 297853881 1.06
tpch_q21/datafusion:parquet 761579956 704665934 1.08
tpch_q22/datafusion:parquet 221209127 221784435 1.00
datafusion / arrow (1.034x ➖, 0↑ 2↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 613038028 585700850 1.05
tpch_q02/datafusion:arrow 168600299 164175724 1.03
tpch_q03/datafusion:arrow 490276263 459626195 1.07
tpch_q04/datafusion:arrow 357598959 330873899 1.08
tpch_q05/datafusion:arrow 996204188 936847707 1.06
tpch_q06/datafusion:arrow 🚨 319937680 281824534 1.14
tpch_q07/datafusion:arrow 1197905820 1168525139 1.03
tpch_q08/datafusion:arrow 1157881040 1153808754 1.00
tpch_q09/datafusion:arrow 1377904993 1360807797 1.01
tpch_q10/datafusion:arrow 589562855 599633049 0.98
tpch_q11/datafusion:arrow 140410168 139575257 1.01
tpch_q12/datafusion:arrow 694146836 736461686 0.94
tpch_q13/datafusion:arrow 507311111 498714050 1.02
tpch_q14/datafusion:arrow 323327596 313898446 1.03
tpch_q15/datafusion:arrow 696837430 691578491 1.01
tpch_q16/datafusion:arrow 106359302 105168384 1.01
tpch_q17/datafusion:arrow 1395323205 1348741009 1.03
tpch_q18/datafusion:arrow 2018741189 1914213531 1.05
tpch_q19/datafusion:arrow 508656143 486894330 1.04
tpch_q20/datafusion:arrow 🚨 540377255 486559361 1.11
tpch_q21/datafusion:arrow 3150369787 3018344162 1.04
tpch_q22/datafusion:arrow 135318326 132783622 1.02
duckdb / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170668527 171402561 1.00
tpch_q02/duckdb:vortex-file-compressed 51606976 52786949 0.98
tpch_q03/duckdb:vortex-file-compressed 122154404 121232315 1.01
tpch_q04/duckdb:vortex-file-compressed 158075755 158558049 1.00
tpch_q05/duckdb:vortex-file-compressed 137596768 138686555 0.99
tpch_q06/duckdb:vortex-file-compressed 35322247 34121799 1.04
tpch_q07/duckdb:vortex-file-compressed 132752276 131909631 1.01
tpch_q08/duckdb:vortex-file-compressed 171053219 167862782 1.02
tpch_q09/duckdb:vortex-file-compressed 395261089 400905417 0.99
tpch_q10/duckdb:vortex-file-compressed 190971920 194533726 0.98
tpch_q11/duckdb:vortex-file-compressed 32328534 32430040 1.00
tpch_q12/duckdb:vortex-file-compressed 100569108 101266110 0.99
tpch_q13/duckdb:vortex-file-compressed 275994874 274427377 1.01
tpch_q14/duckdb:vortex-file-compressed 53247227 53288498 1.00
tpch_q15/duckdb:vortex-file-compressed 88848972 89774362 0.99
tpch_q16/duckdb:vortex-file-compressed 79359438 77143037 1.03
tpch_q17/duckdb:vortex-file-compressed 93085348 91911470 1.01
tpch_q18/duckdb:vortex-file-compressed 288600525 290995953 0.99
tpch_q19/duckdb:vortex-file-compressed 80050506 80675614 0.99
tpch_q20/duckdb:vortex-file-compressed 144126016 144528335 1.00
tpch_q21/duckdb:vortex-file-compressed 498190633 496755185 1.00
tpch_q22/duckdb:vortex-file-compressed 65092716 64015131 1.02
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230897696 227796727 1.01
tpch_q02/duckdb:vortex-compact 56296843 57518826 0.98
tpch_q03/duckdb:vortex-compact 136082126 136995804 0.99
tpch_q04/duckdb:vortex-compact 173015010 169807249 1.02
tpch_q05/duckdb:vortex-compact 164816436 166097015 0.99
tpch_q06/duckdb:vortex-compact 55240702 56718062 0.97
tpch_q07/duckdb:vortex-compact 174388802 176429473 0.99
tpch_q08/duckdb:vortex-compact 189471873 189659952 1.00
tpch_q09/duckdb:vortex-compact 428643664 425340002 1.01
tpch_q10/duckdb:vortex-compact 222574765 220324611 1.01
tpch_q11/duckdb:vortex-compact 39769573 38682653 1.03
tpch_q12/duckdb:vortex-compact 163304274 162447648 1.01
tpch_q13/duckdb:vortex-compact 327741896 326421789 1.00
tpch_q14/duckdb:vortex-compact 71450076 72012458 0.99
tpch_q15/duckdb:vortex-compact 114476285 112674061 1.02
tpch_q16/duckdb:vortex-compact 81450996 79811839 1.02
tpch_q17/duckdb:vortex-compact 108212328 107640468 1.01
tpch_q18/duckdb:vortex-compact 292661690 288596869 1.01
tpch_q19/duckdb:vortex-compact 97422120 97824731 1.00
tpch_q20/duckdb:vortex-compact 179200707 176304205 1.02
tpch_q21/duckdb:vortex-compact 530886672 517995435 1.02
tpch_q22/duckdb:vortex-compact 71443105 71541975 1.00
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265028407 261105992 1.02
tpch_q02/duckdb:parquet 102855374 105060139 0.98
tpch_q03/duckdb:parquet 210195002 209577624 1.00
tpch_q04/duckdb:parquet 137285985 134654402 1.02
tpch_q05/duckdb:parquet 224679564 225136244 1.00
tpch_q06/duckdb:parquet 77327147 75725838 1.02
tpch_q07/duckdb:parquet 188861291 186211896 1.01
tpch_q08/duckdb:parquet 261166167 261335104 1.00
tpch_q09/duckdb:parquet 491477713 475197045 1.03
tpch_q10/duckdb:parquet 619786574 623537949 0.99
tpch_q11/duckdb:parquet 63840763 64417044 0.99
tpch_q12/duckdb:parquet 133507968 130312947 1.02
tpch_q13/duckdb:parquet 444968924 413508575 1.08
tpch_q14/duckdb:parquet 180060938 178840572 1.01
tpch_q15/duckdb:parquet 105566066 105531275 1.00
tpch_q16/duckdb:parquet 162964561 164839732 0.99
tpch_q17/duckdb:parquet 182436410 180435310 1.01
tpch_q18/duckdb:parquet 365180791 367340988 0.99
tpch_q19/duckdb:parquet 283308584 285239874 0.99
tpch_q20/duckdb:parquet 231883927 232854706 1.00
tpch_q21/duckdb:parquet 566136680 569771991 0.99
tpch_q22/duckdb:parquet 293284905 293463453 1.00
duckdb / duckdb (1.002x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120247398 120656332 1.00
tpch_q02/duckdb:duckdb 50293627 51652841 0.97
tpch_q03/duckdb:duckdb 104409712 103345618 1.01
tpch_q04/duckdb:duckdb 142206055 139408949 1.02
tpch_q05/duckdb:duckdb 120367196 119030429 1.01
tpch_q06/duckdb:duckdb 44865379 44611314 1.01
tpch_q07/duckdb:duckdb 92357855 90524359 1.02
tpch_q08/duckdb:duckdb 119109304 119321625 1.00
tpch_q09/duckdb:duckdb 282760200 286818707 0.99
tpch_q10/duckdb:duckdb 218791644 214338467 1.02
tpch_q11/duckdb:duckdb 19295424 19227292 1.00
tpch_q12/duckdb:duckdb 90464776 90282871 1.00
tpch_q13/duckdb:duckdb 233835246 231890039 1.01
tpch_q14/duckdb:duckdb 78516324 77956285 1.01
tpch_q15/duckdb:duckdb 82074903 83255781 0.99
tpch_q16/duckdb:duckdb 76102944 76123614 1.00
tpch_q17/duckdb:duckdb 88221410 87905640 1.00
tpch_q18/duckdb:duckdb 233287656 234844215 0.99
tpch_q19/duckdb:duckdb 123816171 124285144 1.00
tpch_q20/duckdb:duckdb 118211065 117901117 1.00
tpch_q21/duckdb:duckdb 304184612 302918443 1.00
tpch_q22/duckdb:duckdb 70170489 70329889 1.00
File Size Changes (26 files changed, -0.0% overall, 10↑ 16↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 10.0 vortex-file-compressed 5.69 MB 5.80 MB +109.09 KB +1.9%
part_0.vortex 10.0 vortex-compact 16.92 MB 17.07 MB +152.84 KB +0.9%
part_0.vortex 10.0 vortex-file-compressed 24.49 MB 24.57 MB +80.48 KB +0.3%
lineitem_11.vortex 10.0 vortex-file-compressed 134.30 MB 134.48 MB +184.88 KB +0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 133.73 MB 133.86 MB +135.60 KB +0.1%
customer_0.vortex 10.0 vortex-file-compressed 88.49 MB 88.56 MB +70.91 KB +0.1%
orders_0.vortex 10.0 vortex-file-compressed 144.47 MB 144.58 MB +107.27 KB +0.1%
partsupp_1.vortex 10.0 vortex-file-compressed 120.31 MB 120.37 MB +60.52 KB +0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 133.89 MB 133.94 MB +44.61 KB +0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.24 MB 133.27 MB +29.12 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.34 MB 120.32 MB 21.11 KB -0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 133.45 MB 133.42 MB 28.45 KB -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 133.62 MB 133.59 MB 32.12 KB -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.11 MB 134.06 MB 51.66 KB -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.17 MB 134.10 MB 71.47 KB -0.1%
orders_2.vortex 10.0 vortex-file-compressed 145.47 MB 145.38 MB 92.83 KB -0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 134.07 MB 133.98 MB 94.73 KB -0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.25 MB 134.13 MB 115.73 KB -0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 134.19 MB 134.05 MB 144.89 KB -0.1%
lineitem_5.vortex 10.0 vortex-file-compressed 133.53 MB 133.31 MB 218.97 KB -0.2%
partsupp_0.vortex 10.0 vortex-compact 105.11 MB 104.92 MB 198.87 KB -0.2%
part_1.vortex 10.0 vortex-file-compressed 24.83 MB 24.78 MB 59.04 KB -0.2%
orders_1.vortex 10.0 vortex-file-compressed 145.92 MB 145.55 MB 373.91 KB -0.3%
lineitem_6.vortex 10.0 vortex-file-compressed 132.99 MB 132.60 MB 398.66 KB -0.3%
partsupp_1.vortex 10.0 vortex-compact 105.23 MB 104.75 MB 497.35 KB -0.5%
part_1.vortex 10.0 vortex-compact 17.01 MB 16.77 MB 241.43 KB -1.4%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (-0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.7% +4.2% +0.5% +10.0% ➖ noise
1 datafusion:vortex-compact +3.1% +4.2% -1.0% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.1% +4.2% -2.0% +10.0% ➖ noise
1 duckdb:duckdb -0.3% +4.2% -4.3% +10.0% ➖ noise
1 duckdb:vortex-compact +1.4% +4.2% -2.7% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.4% +4.2% -4.4% +10.0% ➖ noise
2 datafusion:arrow +2.7% +2.4% +0.3% +10.0% ➖ noise
2 datafusion:vortex-compact +4.3% +2.4% +1.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +5.4% +2.4% +3.0% +10.0% ➖ noise
2 duckdb:duckdb -2.6% +2.4% -4.9% +10.0% ➖ noise
2 duckdb:vortex-compact -2.1% +2.4% -4.4% +10.4% ➖ noise
2 duckdb:vortex-file-compressed -2.2% +2.4% -4.5% +10.0% ➖ noise
3 datafusion:arrow +6.7% +5.7% +0.9% +10.0% ➖ noise
3 datafusion:vortex-compact +5.8% +5.7% +0.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +6.3% +5.7% +0.5% +10.0% ➖ noise
3 duckdb:duckdb +1.0% +5.7% -4.5% +10.0% ➖ noise
3 duckdb:vortex-compact -0.7% +5.7% -6.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.8% +5.7% -4.7% +10.0% ➖ noise
4 datafusion:arrow +8.1% +3.5% +4.4% +10.0% ➖ noise
4 datafusion:vortex-compact +4.7% +3.5% +1.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +9.0% +3.5% +5.2% +10.0% ➖ noise
4 duckdb:duckdb +2.0% +3.5% -1.5% +10.0% ➖ noise
4 duckdb:vortex-compact +1.9% +3.5% -1.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.3% +3.5% -3.7% +10.0% ➖ noise
5 datafusion:arrow +6.3% +3.6% +2.6% +10.0% ➖ noise
5 datafusion:vortex-compact +2.9% +3.6% -0.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.2% +3.6% +1.6% +10.0% ➖ noise
5 duckdb:duckdb +1.1% +3.6% -2.4% +10.0% ➖ noise
5 duckdb:vortex-compact -0.8% +3.6% -4.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.8% +3.6% -4.2% +10.0% ➖ noise
6 datafusion:arrow +13.5% +2.1% +11.1% +10.0% 🚨 regression
6 datafusion:vortex-compact +3.9% +2.1% +1.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.3% +2.1% -1.8% +10.0% ➖ noise
6 duckdb:duckdb +0.6% +2.1% -1.5% +10.0% ➖ noise
6 duckdb:vortex-compact -2.6% +2.1% -4.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +3.5% +2.1% +1.4% +10.0% ➖ noise
7 datafusion:arrow +2.5% +4.3% -1.7% +10.0% ➖ noise
7 datafusion:vortex-compact +4.4% +4.3% +0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +6.2% +4.3% +1.9% +10.0% ➖ noise
7 duckdb:duckdb +2.0% +4.3% -2.1% +10.0% ➖ noise
7 duckdb:vortex-compact -1.2% +4.3% -5.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.6% +4.3% -3.5% +10.0% ➖ noise
8 datafusion:arrow +0.4% +3.7% -3.2% +10.0% ➖ noise
8 datafusion:vortex-compact +2.3% +3.7% -1.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +7.0% +3.7% +3.2% +10.0% ➖ noise
8 duckdb:duckdb -0.2% +3.7% -3.7% +10.0% ➖ noise
8 duckdb:vortex-compact -0.1% +3.7% -3.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.9% +3.7% -1.7% +10.0% ➖ noise
9 datafusion:arrow +1.3% +3.5% -2.2% +10.0% ➖ noise
9 datafusion:vortex-compact +1.4% +3.5% -2.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +6.3% +3.5% +2.6% +10.0% ➖ noise
9 duckdb:duckdb -1.4% +3.5% -4.8% +10.0% ➖ noise
9 duckdb:vortex-compact +0.8% +3.5% -2.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.4% +3.5% -4.8% +10.0% ➖ noise
10 datafusion:arrow -1.7% -0.0% -1.6% +10.0% ➖ noise
10 datafusion:vortex-compact +2.4% -0.0% +2.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +5.7% -0.0% +5.7% +10.0% ➖ noise
10 duckdb:duckdb +2.1% -0.0% +2.1% +10.0% ➖ noise
10 duckdb:vortex-compact +1.0% -0.0% +1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.8% -0.0% -1.8% +10.0% ➖ noise
11 datafusion:arrow +0.6% +0.6% +0.0% +10.0% ➖ noise
11 datafusion:vortex-compact -0.2% +0.6% -0.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +3.2% +0.6% +2.6% +10.0% ➖ noise
11 duckdb:duckdb +0.4% +0.6% -0.2% +10.0% ➖ noise
11 duckdb:vortex-compact +2.8% +0.6% +2.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.3% +0.6% -0.9% +15.8% ➖ noise
12 datafusion:arrow -5.7% +2.8% -8.3% +39.9% ➖ noise
12 datafusion:vortex-compact +2.1% +2.8% -0.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.9% +2.8% +4.0% +10.0% ➖ noise
12 duckdb:duckdb +0.2% +2.8% -2.5% +10.0% ➖ noise
12 duckdb:vortex-compact +0.5% +2.8% -2.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.7% +2.8% -3.4% +10.0% ➖ noise
13 datafusion:arrow +1.7% +3.4% -1.6% +10.0% ➖ noise
13 datafusion:vortex-compact +2.3% +3.4% -1.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.7% +3.4% -0.7% +10.0% ➖ noise
13 duckdb:duckdb +0.8% +3.4% -2.5% +10.0% ➖ noise
13 duckdb:vortex-compact +0.4% +3.4% -2.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.6% +3.4% -2.8% +10.0% ➖ noise
14 datafusion:arrow +3.0% -1.9% +5.0% +10.0% ➖ noise
14 datafusion:vortex-compact -0.3% -1.9% +1.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +4.0% -1.9% +6.0% +10.0% ➖ noise
14 duckdb:duckdb +0.7% -1.9% +2.7% +10.0% ➖ noise
14 duckdb:vortex-compact -0.8% -1.9% +1.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.1% -1.9% +1.8% +14.8% ➖ noise
15 datafusion:arrow +0.8% +3.6% -2.8% +10.0% ➖ noise
15 datafusion:vortex-compact +1.0% +3.6% -2.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +3.8% +3.6% +0.2% +10.0% ➖ noise
15 duckdb:duckdb -1.4% +3.6% -4.9% +10.0% ➖ noise
15 duckdb:vortex-compact +1.6% +3.6% -2.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.0% +3.6% -4.5% +10.0% ➖ noise
16 datafusion:arrow +1.1% +3.5% -2.3% +10.0% ➖ noise
16 datafusion:vortex-compact +0.7% +3.5% -2.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +5.2% +3.5% +1.6% +10.0% ➖ noise
16 duckdb:duckdb -0.0% +3.5% -3.4% +10.0% ➖ noise
16 duckdb:vortex-compact +2.1% +3.5% -1.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.9% +3.5% -0.6% +10.0% ➖ noise
17 datafusion:arrow +3.5% +2.5% +0.9% +10.0% ➖ noise
17 datafusion:vortex-compact -0.3% +2.5% -2.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +4.7% +2.5% +2.1% +10.0% ➖ noise
17 duckdb:duckdb +0.4% +2.5% -2.1% +10.0% ➖ noise
17 duckdb:vortex-compact +0.5% +2.5% -2.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.3% +2.5% -1.2% +10.0% ➖ noise
18 datafusion:arrow +5.5% +2.0% +3.4% +10.0% ➖ noise
18 datafusion:vortex-compact -1.8% +2.0% -3.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.5% +2.0% +2.5% +10.0% ➖ noise
18 duckdb:duckdb -0.7% +2.0% -2.6% +10.0% ➖ noise
18 duckdb:vortex-compact +1.4% +2.0% -0.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.8% +2.0% -2.8% +10.0% ➖ noise
19 datafusion:arrow +4.5% +0.6% +3.8% +10.0% ➖ noise
19 datafusion:vortex-compact +0.9% +0.6% +0.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +7.9% +0.6% +7.2% +10.0% ➖ noise
19 duckdb:duckdb -0.4% +0.6% -1.0% +10.0% ➖ noise
19 duckdb:vortex-compact -0.4% +0.6% -1.0% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.8% +0.6% -1.4% +10.1% ➖ noise
20 datafusion:arrow +11.1% +2.7% +8.1% +10.0% ➖ noise
20 datafusion:vortex-compact +0.7% +2.7% -1.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.7% +2.7% -0.9% +10.0% ➖ noise
20 duckdb:duckdb +0.3% +2.7% -2.4% +10.0% ➖ noise
20 duckdb:vortex-compact +1.6% +2.7% -1.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.3% +2.7% -2.9% +10.0% ➖ noise
21 datafusion:arrow +4.4% +3.6% +0.7% +10.0% ➖ noise
21 datafusion:vortex-compact -0.7% +3.6% -4.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +3.7% +3.6% +0.1% +10.0% ➖ noise
21 duckdb:duckdb +0.4% +3.6% -3.1% +10.0% ➖ noise
21 duckdb:vortex-compact +2.5% +3.6% -1.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.3% +3.6% -3.2% +10.0% ➖ noise
22 datafusion:arrow +1.9% -0.2% +2.1% +10.0% ➖ noise
22 datafusion:vortex-compact -5.1% -0.2% -4.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.2% -0.2% -3.0% +10.0% ➖ noise
22 duckdb:duckdb -0.2% -0.2% -0.1% +10.0% ➖ noise
22 duckdb:vortex-compact -0.1% -0.2% +0.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +1.7% -0.2% +1.8% +10.0% ➖ noise

@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): 1.012x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.012x ➖, 0↑ 2↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1661990 1662891 1.00
clickbench_q01/datafusion:vortex-file-compressed 16820165 17497090 0.96
clickbench_q02/datafusion:vortex-file-compressed 39315252 36783297 1.07
clickbench_q03/datafusion:vortex-file-compressed 40597528 41657760 0.97
clickbench_q04/datafusion:vortex-file-compressed 288859518 280567295 1.03
clickbench_q05/datafusion:vortex-file-compressed 324788722 336694117 0.96
clickbench_q06/datafusion:vortex-file-compressed 1743285 1641562 1.06
clickbench_q07/datafusion:vortex-file-compressed 20425916 20490827 1.00
clickbench_q08/datafusion:vortex-file-compressed 347402682 354185147 0.98
clickbench_q09/datafusion:vortex-file-compressed 561611820 553880745 1.01
clickbench_q10/datafusion:vortex-file-compressed 75008590 75769922 0.99
clickbench_q11/datafusion:vortex-file-compressed 84845810 85630263 0.99
clickbench_q12/datafusion:vortex-file-compressed 288938868 288350235 1.00
clickbench_q13/datafusion:vortex-file-compressed 435458212 440705424 0.99
clickbench_q14/datafusion:vortex-file-compressed 279530250 271070828 1.03
clickbench_q15/datafusion:vortex-file-compressed 326528189 321540049 1.02
clickbench_q16/datafusion:vortex-file-compressed 700572943 679226103 1.03
clickbench_q17/datafusion:vortex-file-compressed 663858344 661527142 1.00
clickbench_q18/datafusion:vortex-file-compressed 1403573197 1518934657 0.92
clickbench_q19/datafusion:vortex-file-compressed 30340637 29145853 1.04
clickbench_q20/datafusion:vortex-file-compressed 332450375 329320386 1.01
clickbench_q21/datafusion:vortex-file-compressed 421417523 420165982 1.00
clickbench_q22/datafusion:vortex-file-compressed 513090064 534256263 0.96
clickbench_q23/datafusion:vortex-file-compressed 548218014 538329881 1.02
clickbench_q24/datafusion:vortex-file-compressed 51426446 53243245 0.97
clickbench_q25/datafusion:vortex-file-compressed 🚨 8471380 75210519 1.13
clickbench_q26/datafusion:vortex-file-compressed 48891564 46893363 1.04
clickbench_q27/datafusion:vortex-file-compressed 760681499 779888388 0.98
clickbench_q28/datafusion:vortex-file-compressed 5863615371 5871474703 1.00
clickbench_q29/datafusion:vortex-file-compressed 226386223 218328357 1.04
clickbench_q30/datafusion:vortex-file-compressed 257542745 266629634 0.97
clickbench_q31/datafusion:vortex-file-compressed 302762913 288248908 1.05
clickbench_q32/datafusion:vortex-file-compressed 1159859137 1136738438 1.02
clickbench_q33/datafusion:vortex-file-compressed 1402431968 1373270169 1.02
clickbench_q34/datafusion:vortex-file-compressed 1384962107 1370431666 1.01
clickbench_q35/datafusion:vortex-file-compressed 460119477 461411262 1.00
clickbench_q36/datafusion:vortex-file-compressed 77544885 77452179 1.00
clickbench_q37/datafusion:vortex-file-compressed 38391237 35771380 1.07
clickbench_q38/datafusion:vortex-file-compressed 21923952 21224821 1.03
clickbench_q39/datafusion:vortex-file-compressed 142671116 144290653 0.99
clickbench_q40/datafusion:vortex-file-compressed 16613028 16686957 1.00
clickbench_q41/datafusion:vortex-file-compressed 16445352 15417458 1.07
clickbench_q42/datafusion:vortex-file-compressed 🚨 20445261 18337520 1.11
datafusion / parquet (1.004x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1586309 1527101 1.04
clickbench_q01/datafusion:parquet 19721610 20012741 0.99
clickbench_q02/datafusion:parquet 46485649 47889157 0.97
clickbench_q03/datafusion:parquet 37659693 37376538 1.01
clickbench_q04/datafusion:parquet 308265149 305588086 1.01
clickbench_q05/datafusion:parquet 366703212 352923898 1.04
clickbench_q06/datafusion:parquet 1545377 1619732 0.95
clickbench_q07/datafusion:parquet 22543799 22470783 1.00
clickbench_q08/datafusion:parquet 375846187 373445892 1.01
clickbench_q09/datafusion:parquet 623358586 621668024 1.00
clickbench_q10/datafusion:parquet 113959652 108254253 1.05
clickbench_q11/datafusion:parquet 138937422 131936080 1.05
clickbench_q12/datafusion:parquet 344569653 354203420 0.97
clickbench_q13/datafusion:parquet 501764389 516688918 0.97
clickbench_q14/datafusion:parquet 343135500 339312933 1.01
clickbench_q15/datafusion:parquet 344390130 345274446 1.00
clickbench_q16/datafusion:parquet 681652168 681411910 1.00
clickbench_q17/datafusion:parquet 657478782 670308793 0.98
clickbench_q18/datafusion:parquet 1471124725 1386447648 1.06
clickbench_q19/datafusion:parquet 28810063 29986460 0.96
clickbench_q20/datafusion:parquet 599214708 601855722 1.00
clickbench_q21/datafusion:parquet 670036590 665618382 1.01
clickbench_q22/datafusion:parquet 992477204 968491526 1.02
clickbench_q23/datafusion:parquet 3816108024 3775848071 1.01
clickbench_q24/datafusion:parquet 84199997 82930442 1.02
clickbench_q25/datafusion:parquet 132617267 136463150 0.97
clickbench_q26/datafusion:parquet 84199906 83388175 1.01
clickbench_q27/datafusion:parquet 1063310506 1076861051 0.99
clickbench_q28/datafusion:parquet 6649235953 6720147285 0.99
clickbench_q29/datafusion:parquet 239022057 232285410 1.03
clickbench_q30/datafusion:parquet 336286604 335013675 1.00
clickbench_q31/datafusion:parquet 374251925 385771167 0.97
clickbench_q32/datafusion:parquet 1249150190 1211975976 1.03
clickbench_q33/datafusion:parquet 1520656077 1504917219 1.01
clickbench_q34/datafusion:parquet 1493585637 1520067837 0.98
clickbench_q35/datafusion:parquet 472543147 473457979 1.00
clickbench_q36/datafusion:parquet 148105949 153988973 0.96
clickbench_q37/datafusion:parquet 59747173 58086934 1.03
clickbench_q38/datafusion:parquet 86413563 87518908 0.99
clickbench_q39/datafusion:parquet 276275884 272403071 1.01
clickbench_q40/datafusion:parquet 32492559 30863149 1.05
clickbench_q41/datafusion:parquet 27270677 26552161 1.03
clickbench_q42/datafusion:parquet 31025581 31091251 1.00
duckdb / vortex-file-compressed (1.011x ➖, 1↑ 4↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 7125504 6045019 1.18
clickbench_q01/duckdb:vortex-file-compressed 11509609 12051593 0.96
clickbench_q02/duckdb:vortex-file-compressed 25485290 26225921 0.97
clickbench_q03/duckdb:vortex-file-compressed 30098826 30709300 0.98
clickbench_q04/duckdb:vortex-file-compressed 188372731 189824712 0.99
clickbench_q05/duckdb:vortex-file-compressed 180633256 186941297 0.97
clickbench_q06/duckdb:vortex-file-compressed 20379522 20379600 1.00
clickbench_q07/duckdb:vortex-file-compressed 14525688 14339057 1.01
clickbench_q08/duckdb:vortex-file-compressed 263932515 261996401 1.01
clickbench_q09/duckdb:vortex-file-compressed 336022551 346910308 0.97
clickbench_q10/duckdb:vortex-file-compressed 67623355 71125165 0.95
clickbench_q11/duckdb:vortex-file-compressed 78348788 80117786 0.98
clickbench_q12/duckdb:vortex-file-compressed 206174201 204318116 1.01
clickbench_q13/duckdb:vortex-file-compressed 412093435 417533062 0.99
clickbench_q14/duckdb:vortex-file-compressed 244674479 233560122 1.05
clickbench_q15/duckdb:vortex-file-compressed 251816371 250302332 1.01
clickbench_q16/duckdb:vortex-file-compressed 543392945 532217374 1.02
clickbench_q17/duckdb:vortex-file-compressed 436058639 423215236 1.03
clickbench_q18/duckdb:vortex-file-compressed 969371516 948669582 1.02
clickbench_q19/duckdb:vortex-file-compressed 23004716 21859384 1.05
clickbench_q20/duckdb:vortex-file-compressed 321825057 322718218 1.00
clickbench_q21/duckdb:vortex-file-compressed 402690332 406784635 0.99
clickbench_q22/duckdb:vortex-file-compressed 🚀 596572324 667621454 0.89
clickbench_q23/duckdb:vortex-file-compressed 187042078 190197027 0.98
clickbench_q24/duckdb:vortex-file-compressed 🚨 48983927 43910860 1.12
clickbench_q25/duckdb:vortex-file-compressed 84857411 79292498 1.07
clickbench_q26/duckdb:vortex-file-compressed 🚨 55176530 49894287 1.11
clickbench_q27/duckdb:vortex-file-compressed 533520418 534554850 1.00
clickbench_q28/duckdb:vortex-file-compressed 3088602417 3094557927 1.00
clickbench_q29/duckdb:vortex-file-compressed 🚨 38563928 28038137 1.38
clickbench_q30/duckdb:vortex-file-compressed 216945164 217591604 1.00
clickbench_q31/duckdb:vortex-file-compressed 314134317 317638016 0.99
clickbench_q32/duckdb:vortex-file-compressed 1144814927 1131037485 1.01
clickbench_q33/duckdb:vortex-file-compressed 1115932449 1154830182 0.97
clickbench_q34/duckdb:vortex-file-compressed 1208925981 1267310676 0.95
clickbench_q35/duckdb:vortex-file-compressed 377440171 380704047 0.99
clickbench_q36/duckdb:vortex-file-compressed 29316273 27776522 1.06
clickbench_q37/duckdb:vortex-file-compressed 21066039 19948422 1.06
clickbench_q38/duckdb:vortex-file-compressed 21649295 21865462 0.99
clickbench_q39/duckdb:vortex-file-compressed 47147720 46851363 1.01
clickbench_q40/duckdb:vortex-file-compressed 20426533 20634056 0.99
clickbench_q41/duckdb:vortex-file-compressed 19825160 20462401 0.97
clickbench_q42/duckdb:vortex-file-compressed 19325379 20270610 0.95
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23488034 23000976 1.02
clickbench_q01/duckdb:parquet 30349068 28698378 1.06
clickbench_q02/duckdb:parquet 49276416 49685795 0.99
clickbench_q03/duckdb:parquet 40845744 40952035 1.00
clickbench_q04/duckdb:parquet 206329096 204558858 1.01
clickbench_q05/duckdb:parquet 262653765 262269038 1.00
clickbench_q06/duckdb:parquet 48064074 47829266 1.00
clickbench_q07/duckdb:parquet 31648599 31137188 1.02
clickbench_q08/duckdb:parquet 271708650 269311698 1.01
clickbench_q09/duckdb:parquet 398834895 399870587 1.00
clickbench_q10/duckdb:parquet 81499618 82034627 0.99
clickbench_q11/duckdb:parquet 100726394 99587599 1.01
clickbench_q12/duckdb:parquet 279000443 281972544 0.99
clickbench_q13/duckdb:parquet 469343730 470466281 1.00
clickbench_q14/duckdb:parquet 314459075 318027169 0.99
clickbench_q15/duckdb:parquet 261741062 259612710 1.01
clickbench_q16/duckdb:parquet 593613805 603311737 0.98
clickbench_q17/duckdb:parquet 496213073 502195341 0.99
clickbench_q18/duckdb:parquet 1031125340 1042889407 0.99
clickbench_q19/duckdb:parquet 27530598 27680517 0.99
clickbench_q20/duckdb:parquet 412515549 414958978 0.99
clickbench_q21/duckdb:parquet 531132106 534003237 0.99
clickbench_q22/duckdb:parquet 917460595 916564259 1.00
clickbench_q23/duckdb:parquet 267802882 263418694 1.02
clickbench_q24/duckdb:parquet 69796863 71734765 0.97
clickbench_q25/duckdb:parquet 163415552 163359868 1.00
clickbench_q26/duckdb:parquet 52628302 57188619 0.92
clickbench_q27/duckdb:parquet 634860036 640756711 0.99
clickbench_q28/duckdb:parquet 4877808216 4885512707 1.00
clickbench_q29/duckdb:parquet 41860898 42511500 0.98
clickbench_q30/duckdb:parquet 311799396 312800615 1.00
clickbench_q31/duckdb:parquet 374232211 377962603 0.99
clickbench_q32/duckdb:parquet 1104277452 1115867807 0.99
clickbench_q33/duckdb:parquet 1100321241 1115571859 0.99
clickbench_q34/duckdb:parquet 1156742018 1155197444 1.00
clickbench_q35/duckdb:parquet 369094315 371987986 0.99
clickbench_q36/duckdb:parquet 50936844 47743901 1.07
clickbench_q37/duckdb:parquet 33839603 34528569 0.98
clickbench_q38/duckdb:parquet 36214962 36754906 0.99
clickbench_q39/duckdb:parquet 77971797 84751131 0.92
clickbench_q40/duckdb:parquet 20176888 20365270 0.99
clickbench_q41/duckdb:parquet 20680495 20607615 1.00
clickbench_q42/duckdb:parquet 22792677 22082937 1.03
duckdb / duckdb (1.010x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17970401 17181883 1.05
clickbench_q01/duckdb:duckdb 35075333 33890127 1.03
clickbench_q02/duckdb:duckdb 53207881 51227998 1.04
clickbench_q03/duckdb:duckdb 55637267 55320652 1.01
clickbench_q04/duckdb:duckdb 211533230 213290529 0.99
clickbench_q05/duckdb:duckdb 284306251 282440808 1.01
clickbench_q06/duckdb:duckdb 34594968 34267307 1.01
clickbench_q07/duckdb:duckdb 35083493 34834704 1.01
clickbench_q08/duckdb:duckdb 271858759 275194804 0.99
clickbench_q09/duckdb:duckdb 395151588 393710287 1.00
clickbench_q10/duckdb:duckdb 116041195 117487757 0.99
clickbench_q11/duckdb:duckdb 128128369 126915086 1.01
clickbench_q12/duckdb:duckdb 261256681 259914531 1.01
clickbench_q13/duckdb:duckdb 446586117 442951734 1.01
clickbench_q14/duckdb:duckdb 285444427 285497296 1.00
clickbench_q15/duckdb:duckdb 244883190 241611753 1.01
clickbench_q16/duckdb:duckdb 562146655 557876308 1.01
clickbench_q17/duckdb:duckdb 477892767 472323285 1.01
clickbench_q18/duckdb:duckdb 1013616430 1009783214 1.00
clickbench_q19/duckdb:duckdb 34032071 34967182 0.97
clickbench_q20/duckdb:duckdb 478705693 485087406 0.99
clickbench_q21/duckdb:duckdb 483364661 475636387 1.02
clickbench_q22/duckdb:duckdb 559271711 545989011 1.02
clickbench_q23/duckdb:duckdb 268091928 258387528 1.04
clickbench_q24/duckdb:duckdb 61194887 60918823 1.00
clickbench_q25/duckdb:duckdb 149821997 149993880 1.00
clickbench_q26/duckdb:duckdb 62385480 62206844 1.00
clickbench_q27/duckdb:duckdb 572510459 552098644 1.04
clickbench_q28/duckdb:duckdb 4721108549 4509626789 1.05
clickbench_q29/duckdb:duckdb 50891888 51284697 0.99
clickbench_q30/duckdb:duckdb 290101097 278145850 1.04
clickbench_q31/duckdb:duckdb 378264166 368375366 1.03
clickbench_q32/duckdb:duckdb 1110968517 1116952787 0.99
clickbench_q33/duckdb:duckdb 1110052713 1117217073 0.99
clickbench_q34/duckdb:duckdb 1197154969 1198831465 1.00
clickbench_q35/duckdb:duckdb 301693093 299337035 1.01
clickbench_q36/duckdb:duckdb 49824448 50361154 0.99
clickbench_q37/duckdb:duckdb 29066769 28714644 1.01
clickbench_q38/duckdb:duckdb 34570624 33750034 1.02
clickbench_q39/duckdb:duckdb 81702840 79563300 1.03
clickbench_q40/duckdb:duckdb 28764191 27878138 1.03
clickbench_q41/duckdb:duckdb 27671284 27135388 1.02
clickbench_q42/duckdb:duckdb 29488221 30822841 0.96
File Size Changes (103 files changed, -0.0% overall, 57↑ 46↓)
File Scale Format Base HEAD Change %
hits_90.vortex 1.0 vortex-file-compressed 140.07 MB 142.07 MB +2.00 MB +1.4%
hits_37.vortex 1.0 vortex-file-compressed 85.81 MB 86.04 MB +236.02 KB +0.3%
hits_31.vortex 1.0 vortex-file-compressed 90.15 MB 90.37 MB +220.45 KB +0.2%
hits_79.vortex 1.0 vortex-file-compressed 145.01 MB 145.32 MB +319.32 KB +0.2%
hits_97.vortex 1.0 vortex-file-compressed 107.02 MB 107.21 MB +194.23 KB +0.2%
hits_68.vortex 1.0 vortex-file-compressed 123.05 MB 123.26 MB +214.80 KB +0.2%
hits_53.vortex 1.0 vortex-file-compressed 87.52 MB 87.66 MB +140.32 KB +0.2%
hits_67.vortex 1.0 vortex-file-compressed 184.06 MB 184.32 MB +265.94 KB +0.1%
hits_24.vortex 1.0 vortex-file-compressed 77.47 MB 77.55 MB +79.71 KB +0.1%
hits_59.vortex 1.0 vortex-file-compressed 101.90 MB 102.00 MB +100.16 KB +0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.52 MB 68.58 MB +62.98 KB +0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.62 MB 69.68 MB +63.15 KB +0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.29 MB 69.35 MB +61.17 KB +0.1%
hits_99.vortex 1.0 vortex-file-compressed 123.20 MB 123.30 MB +107.65 KB +0.1%
hits_97.vortex 1.0 vortex-compact 68.98 MB 69.04 MB +60.21 KB +0.1%
hits_57.vortex 1.0 vortex-file-compressed 128.16 MB 128.27 MB +109.01 KB +0.1%
hits_4.vortex 1.0 vortex-file-compressed 108.67 MB 108.76 MB +91.27 KB +0.1%
hits_88.vortex 1.0 vortex-file-compressed 111.44 MB 111.53 MB +88.36 KB +0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.50 MB 172.62 MB +126.05 KB +0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.59 MB 138.69 MB +98.77 KB +0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.42 MB 184.55 MB +130.00 KB +0.1%
hits_38.vortex 1.0 vortex-file-compressed 99.22 MB 99.29 MB +68.83 KB +0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.35 MB 90.41 MB +60.95 KB +0.1%
hits_29.vortex 1.0 vortex-file-compressed 59.76 MB 59.80 MB +38.73 KB +0.1%
hits_35.vortex 1.0 vortex-file-compressed 115.15 MB 115.22 MB +74.18 KB +0.1%
hits_96.vortex 1.0 vortex-file-compressed 135.70 MB 135.78 MB +85.49 KB +0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.29 MB 99.35 MB +61.80 KB +0.1%
hits_78.vortex 1.0 vortex-file-compressed 164.23 MB 164.33 MB +101.91 KB +0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.32 MB 93.37 MB +53.18 KB +0.1%
hits_93.vortex 1.0 vortex-file-compressed 90.50 MB 90.55 MB +47.02 KB +0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.49 MB 69.53 MB +33.69 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.94 MB 119.99 MB +54.22 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.26 MB 101.30 MB +44.17 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.81 MB 138.86 MB +54.76 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.89 MB 146.95 MB +57.55 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.90 MB 104.94 MB +38.81 KB +0.0%
hits_41.vortex 1.0 vortex-file-compressed 224.14 MB 224.22 MB +79.63 KB +0.0%
hits_77.vortex 1.0 vortex-file-compressed 168.51 MB 168.56 MB +55.53 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.97 MB 62.99 MB +19.40 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 102.04 MB 102.07 MB +29.70 KB +0.0%
hits_16.vortex 1.0 vortex-file-compressed 79.98 MB 80.00 MB +21.24 KB +0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.94 MB 77.96 MB +17.27 KB +0.0%
hits_21.vortex 1.0 vortex-file-compressed 93.99 MB 94.00 MB +20.02 KB +0.0%
hits_14.vortex 1.0 vortex-file-compressed 111.37 MB 111.40 MB +22.81 KB +0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.00 MB 80.01 MB +13.04 KB +0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.85 MB 84.86 MB +12.41 KB +0.0%
hits_12.vortex 1.0 vortex-file-compressed 101.09 MB 101.10 MB +11.40 KB +0.0%
hits_64.vortex 1.0 vortex-file-compressed 81.30 MB 81.31 MB +8.41 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.11 MB 223.13 MB +19.06 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 87.17 MB 87.18 MB +6.18 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.66 MB 93.66 MB +6.38 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.67 MB 123.68 MB +7.62 KB +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.03 MB 28.03 MB +1.62 KB +0.0%
hits_7.vortex 1.0 vortex-file-compressed 94.00 MB 94.01 MB +3.71 KB +0.0%
hits_85.vortex 1.0 vortex-file-compressed 91.93 MB 91.94 MB +2.98 KB +0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.40 MB 221.40 MB +1.54 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.81 MB 89.81 MB +160 B +0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.83 MB 104.83 MB 688 B -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.69 MB 277.68 MB 18.38 KB -0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.38 MB 63.38 MB 5.36 KB -0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.89 MB 117.88 MB 12.21 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.63 MB 89.61 MB 10.95 KB -0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.40 MB 118.38 MB 15.71 KB -0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.88 MB 100.86 MB 20.60 KB -0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.26 MB 57.25 MB 14.13 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.33 MB 93.31 MB 23.05 KB -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.33 MB 41.32 MB 10.23 KB -0.0%
hits_91.vortex 1.0 vortex-file-compressed 97.26 MB 97.23 MB 27.62 KB -0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.80 MB 183.75 MB 56.95 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.17 MB 122.13 MB 39.06 KB -0.0%
hits_76.vortex 1.0 vortex-file-compressed 114.50 MB 114.46 MB 41.83 KB -0.0%
hits_26.vortex 1.0 vortex-file-compressed 110.15 MB 110.11 MB 40.44 KB -0.0%
hits_5.vortex 1.0 vortex-file-compressed 93.00 MB 92.97 MB 34.27 KB -0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.62 MB 96.58 MB 37.25 KB -0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.87 MB 119.83 MB 46.80 KB -0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.43 MB 103.39 MB 41.27 KB -0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.62 MB 186.54 MB 75.17 KB -0.0%
hits_49.vortex 1.0 vortex-file-compressed 75.79 MB 75.76 MB 31.52 KB -0.0%
hits_86.vortex 1.0 vortex-file-compressed 69.54 MB 69.51 MB 29.91 KB -0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.36 MB 90.32 MB 46.24 KB -0.0%
hits_3.vortex 1.0 vortex-file-compressed 142.39 MB 142.32 MB 73.27 KB -0.1%
hits_52.vortex 1.0 vortex-file-compressed 105.27 MB 105.21 MB 56.45 KB -0.1%
hits_82.vortex 1.0 vortex-file-compressed 99.90 MB 99.85 MB 53.86 KB -0.1%
hits_50.vortex 1.0 vortex-file-compressed 179.48 MB 179.38 MB 98.91 KB -0.1%
hits_19.vortex 1.0 vortex-file-compressed 73.61 MB 73.57 MB 41.02 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.40 MB 80.35 MB 47.45 KB -0.1%
hits_17.vortex 1.0 vortex-file-compressed 87.57 MB 87.52 MB 52.36 KB -0.1%
hits_13.vortex 1.0 vortex-file-compressed 99.35 MB 99.29 MB 68.77 KB -0.1%
hits_27.vortex 1.0 vortex-file-compressed 122.35 MB 122.27 MB 87.23 KB -0.1%
hits_34.vortex 1.0 vortex-file-compressed 97.89 MB 97.82 MB 71.05 KB -0.1%
hits_22.vortex 1.0 vortex-file-compressed 78.63 MB 78.58 MB 61.04 KB -0.1%
hits_43.vortex 1.0 vortex-file-compressed 227.42 MB 227.21 MB 211.26 KB -0.1%
hits_84.vortex 1.0 vortex-file-compressed 117.43 MB 117.31 MB 120.08 KB -0.1%
hits_69.vortex 1.0 vortex-file-compressed 123.18 MB 123.05 MB 131.78 KB -0.1%
hits_25.vortex 1.0 vortex-file-compressed 114.13 MB 114.01 MB 122.23 KB -0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.91 MB 66.83 MB 83.08 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 187.07 MB 186.80 MB 268.26 KB -0.1%
hits_15.vortex 1.0 vortex-file-compressed 89.41 MB 89.27 MB 148.91 KB -0.2%
hits_27.vortex 1.0 vortex-compact 69.95 MB 69.81 MB 143.06 KB -0.2%
hits_62.vortex 1.0 vortex-file-compressed 117.60 MB 117.31 MB 299.29 KB -0.2%
hits_73.vortex 1.0 vortex-file-compressed 110.89 MB 110.46 MB 442.88 KB -0.4%
hits_55.vortex 1.0 vortex-file-compressed 169.16 MB 166.57 MB 2.58 MB -1.5%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (-0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -0.1% +3.0% -3.0% +839.3% ➖ noise
0 duckdb:duckdb +4.6% +3.0% +1.5% +273.4% ➖ noise
0 duckdb:vortex-file-compressed +17.9% +3.0% +14.4% +471.0% ➖ noise
1 datafusion:vortex-file-compressed -3.9% +2.1% -5.8% +21.9% ➖ noise
1 duckdb:duckdb +3.5% +2.1% +1.4% +62.4% ➖ noise
1 duckdb:vortex-file-compressed -4.5% +2.1% -6.4% +23.4% ➖ noise
2 datafusion:vortex-file-compressed +6.9% -1.9% +8.9% +23.1% ➖ noise
2 duckdb:duckdb +3.9% -1.9% +5.9% +35.3% ➖ noise
2 duckdb:vortex-file-compressed -2.8% -1.9% -1.0% +11.1% ➖ noise
3 datafusion:vortex-file-compressed -2.5% +0.2% -2.8% +152.9% ➖ noise
3 duckdb:duckdb +0.6% +0.2% +0.3% +69.5% ➖ noise
3 duckdb:vortex-file-compressed -2.0% +0.2% -2.2% +67.9% ➖ noise
4 datafusion:vortex-file-compressed +3.0% +0.9% +2.1% +10.4% ➖ noise
4 duckdb:duckdb -0.8% +0.9% -1.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.8% +0.9% -1.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.5% +2.0% -5.4% +10.0% ➖ noise
5 duckdb:duckdb +0.7% +2.0% -1.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.4% +2.0% -5.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.2% -2.1% +8.5% +39.6% ➖ noise
6 duckdb:duckdb +1.0% -2.1% +3.1% +15.0% ➖ noise
6 duckdb:vortex-file-compressed -0.0% -2.1% +2.1% +22.3% ➖ noise
7 datafusion:vortex-file-compressed -0.3% +1.0% -1.3% +10.0% ➖ noise
7 duckdb:duckdb +0.7% +1.0% -0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.3% +1.0% +0.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.9% +0.8% -2.7% +10.0% ➖ noise
8 duckdb:duckdb -1.2% +0.8% -2.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.7% +0.8% -0.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.4% +0.0% +1.4% +10.0% ➖ noise
9 duckdb:duckdb +0.4% +0.0% +0.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.1% +0.0% -3.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.0% +2.3% -3.2% +10.0% ➖ noise
10 duckdb:duckdb -1.2% +2.3% -3.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -4.9% +2.3% -7.0% +11.9% ➖ noise
11 datafusion:vortex-file-compressed -0.9% +3.2% -4.0% +10.0% ➖ noise
11 duckdb:duckdb +1.0% +3.2% -2.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.2% +3.2% -5.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.2% -1.9% +2.1% +10.0% ➖ noise
12 duckdb:duckdb +0.5% -1.9% +2.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.9% -1.9% +2.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.2% -1.6% +0.4% +10.0% ➖ noise
13 duckdb:duckdb +0.8% -1.6% +2.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.3% -1.6% +0.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +3.1% -0.0% +3.1% +10.0% ➖ noise
14 duckdb:duckdb -0.0% -0.0% -0.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +4.8% -0.0% +4.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.6% +0.3% +1.3% +10.0% ➖ noise
15 duckdb:duckdb +1.4% +0.3% +1.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.6% +0.3% +0.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.1% -0.8% +4.0% +10.0% ➖ noise
16 duckdb:duckdb +0.8% -0.8% +1.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.1% -0.8% +2.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.4% -1.6% +1.9% +10.0% ➖ noise
17 duckdb:duckdb +1.2% -1.6% +2.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +3.0% -1.6% +4.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -7.6% +2.4% -9.8% +10.0% ✅ faster
18 duckdb:duckdb +0.4% +2.4% -2.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.2% +2.4% -0.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +4.1% -2.2% +6.5% +40.3% ➖ noise
19 duckdb:duckdb -2.7% -2.2% -0.4% +22.1% ➖ noise
19 duckdb:vortex-file-compressed +5.2% -2.2% +7.7% +28.9% ➖ noise
20 datafusion:vortex-file-compressed +1.0% -0.5% +1.5% +107.9% ➖ noise
20 duckdb:duckdb -1.3% -0.5% -0.8% +108.4% ➖ noise
20 duckdb:vortex-file-compressed -0.3% -0.5% +0.2% +11.6% ➖ noise
21 datafusion:vortex-file-compressed +0.3% +0.1% +0.2% +10.0% ➖ noise
21 duckdb:duckdb +1.6% +0.1% +1.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.0% +0.1% -1.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.0% +1.3% -5.2% +10.0% ➖ noise
22 duckdb:duckdb +2.4% +1.3% +1.1% +49.6% ➖ noise
22 duckdb:vortex-file-compressed -10.6% +1.3% -11.8% +17.7% ➖ noise
23 datafusion:vortex-file-compressed +1.8% +1.4% +0.5% +39.7% ➖ noise
23 duckdb:duckdb +3.8% +1.4% +2.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -1.7% +1.4% -3.0% +17.1% ➖ noise
24 datafusion:vortex-file-compressed -3.4% -0.6% -2.8% +14.4% ➖ noise
24 duckdb:duckdb +0.5% -0.6% +1.1% +31.3% ➖ noise
24 duckdb:vortex-file-compressed +11.6% -0.6% +12.2% +12.2% ➖ noise
25 datafusion:vortex-file-compressed +12.6% -1.4% +14.2% +11.7% 🚨 regression
25 duckdb:duckdb -0.1% -1.4% +1.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +7.0% -1.4% +8.5% +18.0% ➖ noise
26 datafusion:vortex-file-compressed +4.3% -3.6% +8.2% +10.9% ➖ noise
26 duckdb:duckdb +0.3% -3.6% +4.0% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +10.6% -3.6% +14.7% +23.0% ➖ noise
27 datafusion:vortex-file-compressed -2.5% -1.1% -1.4% +10.0% ➖ noise
27 duckdb:duckdb +3.7% -1.1% +4.8% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -0.2% -1.1% +0.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.1% -0.6% +0.5% +10.0% ➖ noise
28 duckdb:duckdb +4.7% -0.6% +5.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.2% -0.6% +0.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +3.7% +0.7% +3.0% +12.9% ➖ noise
29 duckdb:duckdb -0.8% +0.7% -1.4% +10.9% ➖ noise
29 duckdb:vortex-file-compressed +37.5% +0.7% +36.6% +31.1% 🚨 regression
30 datafusion:vortex-file-compressed -3.4% +0.0% -3.4% +10.0% ➖ noise
30 duckdb:duckdb +4.3% +0.0% +4.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.3% +0.0% -0.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +5.0% -2.0% +7.2% +10.0% ➖ noise
31 duckdb:duckdb +2.7% -2.0% +4.8% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -1.1% -2.0% +0.9% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +2.0% +1.0% +1.0% +10.0% ➖ noise
32 duckdb:duckdb -0.5% +1.0% -1.5% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +1.2% +1.0% +0.2% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +2.1% -0.2% +2.3% +10.0% ➖ noise
33 duckdb:duckdb -0.6% -0.2% -0.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.4% -0.2% -3.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.1% -0.8% +1.9% +10.0% ➖ noise
34 duckdb:duckdb -0.1% -0.8% +0.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -4.6% -0.8% -3.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.3% -0.5% +0.2% +10.0% ➖ noise
35 duckdb:duckdb +0.8% -0.5% +1.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.9% -0.5% -0.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.1% +1.3% -1.2% +10.4% ➖ noise
36 duckdb:duckdb -1.1% +1.3% -2.3% +12.0% ➖ noise
36 duckdb:vortex-file-compressed +5.5% +1.3% +4.2% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +7.3% +0.4% +6.9% +10.0% ➖ noise
37 duckdb:duckdb +1.2% +0.4% +0.8% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +5.6% +0.4% +5.2% +13.9% ➖ noise
38 datafusion:vortex-file-compressed +3.3% -1.4% +4.7% +18.6% ➖ noise
38 duckdb:duckdb +2.4% -1.4% +3.9% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -1.0% -1.4% +0.4% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -1.1% -3.4% +2.4% +10.0% ➖ noise
39 duckdb:duckdb +2.7% -3.4% +6.3% +19.0% ➖ noise
39 duckdb:vortex-file-compressed +0.6% -3.4% +4.2% +10.2% ➖ noise
40 datafusion:vortex-file-compressed -0.4% +2.1% -2.5% +10.0% ➖ noise
40 duckdb:duckdb +3.2% +2.1% +1.0% +11.8% ➖ noise
40 duckdb:vortex-file-compressed -1.0% +2.1% -3.1% +21.6% ➖ noise
41 datafusion:vortex-file-compressed +6.7% +1.5% +5.1% +15.6% ➖ noise
41 duckdb:duckdb +2.0% +1.5% +0.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -3.1% +1.5% -4.6% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +11.5% +1.5% +9.9% +17.0% ➖ noise
42 duckdb:duckdb -4.3% +1.5% -5.7% +23.2% ➖ noise
42 duckdb:vortex-file-compressed -4.7% +1.5% -6.1% +13.5% ➖ noise

@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.846x ✅
Parquet (geomean): 0.933x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.901x ➖, 20↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 1750637 2379551 0.74
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1061043 1110703 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8302507135 9032701311 0.92
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8191115553 8907155943 0.92
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3886670 3691667 1.05
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2854122 3402916 0.84
random-access/feature-vectors/uniform/lance-tokio-local-disk 1222496 1244407 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1924498 1978165 0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8317808558 8743409973 0.95
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8497281128 8779505638 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 6146437 7055013 0.87
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 6097226 6833116 0.89
random-access/lance-tokio-local-disk 645227 671292 0.96
random-access/lance-tokio-local-disk-footer 1294995 1374705 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk 237972 255738 0.93
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 583439 625350 0.93
random-access/nested-lists/correlated/parquet-tokio-local-disk 134236741 136170686 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 129805463 135268642 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk 654574 719349 0.91
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 702398 740056 0.95
random-access/nested-lists/uniform/lance-tokio-local-disk 1009364 1082998 0.93
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1346647 1473230 0.91
random-access/nested-lists/uniform/parquet-tokio-local-disk 129334074 135075124 0.96
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 129742675 135537158 0.96
random-access/nested-lists/uniform/vortex-tokio-local-disk 2256705 2430344 0.93
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2089785 2360581 0.89
random-access/nested-structs/correlated/lance-tokio-local-disk 364239 393136 0.93
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 542295 592260 0.92
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 21990324 24956777 0.88
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚀 21591808 24718927 0.87
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 701620 871369 0.81
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 679710 906280 0.75
random-access/nested-structs/uniform/lance-tokio-local-disk 2646953 2721394 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2779133 2969888 0.94
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚀 21720900 24547247 0.88
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 21899858 24454256 0.90
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1534930 1889869 0.81
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1546447 1855981 0.83
random-access/parquet-tokio-local-disk 166889576 174660938 0.96
random-access/parquet-tokio-local-disk-footer 165765074 176602039 0.94
random-access/taxi/correlated/lance-tokio-local-disk 941427 984729 0.96
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚀 1810322 2050109 0.88
random-access/taxi/correlated/parquet-tokio-local-disk 250878054 266857678 0.94
random-access/taxi/correlated/parquet-tokio-local-disk-footer 250652969 266977639 0.94
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1411748 2006439 0.70
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1535694 2030906 0.76
random-access/taxi/uniform/lance-tokio-local-disk 9427112 10031108 0.94
random-access/taxi/uniform/lance-tokio-local-disk-footer 9939980 10709987 0.93
random-access/taxi/uniform/parquet-tokio-local-disk 266233884 283928029 0.94
random-access/taxi/uniform/parquet-tokio-local-disk-footer 267533635 284528989 0.94
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4027243 4781884 0.84
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4075390 4764647 0.86
random-access/vortex-tokio-local-disk 🚀 1055489 1301119 0.81
random-access/vortex-tokio-local-disk-footer 🚀 1083576 1373437 0.79

@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+2.9%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 1.158x ❌
Parquet (geomean): 1.143x ❌
Shifts: Parquet (control) +14.3% · Median polish +15.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.185x ❌, 0↑ 7↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 🚨 168040473 137799694 1.22
appian_q02/datafusion:vortex-file-compressed 🚨 802620046 668827668 1.20
appian_q03/datafusion:vortex-file-compressed 🚨 450202359 365925192 1.23
appian_q04/datafusion:vortex-file-compressed 30496288168 28372105575 1.07
appian_q05/datafusion:vortex-file-compressed 🚨 332587244 268352381 1.24
appian_q06/datafusion:vortex-file-compressed 🚨 513877993 429610468 1.20
appian_q07/datafusion:vortex-file-compressed 🚨 555582143 462014155 1.20
appian_q08/datafusion:vortex-file-compressed 🚨 2141977697 1898043468 1.13
datafusion / parquet (1.152x ❌, 0↑ 6↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/datafusion:parquet 🚨 155152664 137932317 1.12
appian_q02/datafusion:parquet 🚨 811825265 681312608 1.19
appian_q03/datafusion:parquet 🚨 442155711 368990084 1.20
appian_q04/datafusion:parquet 30571898643 28368972734 1.08
appian_q05/datafusion:parquet 🚨 353866055 287970937 1.23
appian_q06/datafusion:parquet 🚨 512119687 436705751 1.17
appian_q07/datafusion:parquet 🚨 528792885 462180259 1.14
appian_q08/datafusion:parquet 2038727588 1881542311 1.08
duckdb / vortex-file-compressed (1.132x ❌, 0↑ 5↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 212020340 195411314 1.08
appian_q02/duckdb:vortex-file-compressed 🚨 711892675 624469185 1.14
appian_q03/duckdb:vortex-file-compressed 🚨 314564577 261373895 1.20
appian_q04/duckdb:vortex-file-compressed 🚨 1600192008 1337184552 1.20
appian_q05/duckdb:vortex-file-compressed 🚨 354250753 298213246 1.19
appian_q06/duckdb:vortex-file-compressed 🚨 907751407 813182612 1.12
appian_q07/duckdb:vortex-file-compressed 367949056 348189349 1.06
appian_q08/duckdb:vortex-file-compressed 1424759165 1319636609 1.08
duckdb / parquet (1.134x ❌, 0↑ 5↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/duckdb:parquet 222303289 203365905 1.09
appian_q02/duckdb:parquet 🚨 704920368 607789187 1.16
appian_q03/duckdb:parquet 🚨 341623990 291279591 1.17
appian_q04/duckdb:parquet 🚨 1586230528 1346376449 1.18
appian_q05/duckdb:parquet 🚨 369010854 304046394 1.21
appian_q06/duckdb:parquet 878891884 804970780 1.09
appian_q07/duckdb:parquet 390819817 364664403 1.07
appian_q08/duckdb:parquet 🚨 1402028706 1274227956 1.10
duckdb / duckdb (1.115x ❌, 0↑ 5↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 🚨 195964069 174553428 1.12
appian_q02/duckdb:duckdb 🚨 660968934 559692873 1.18
appian_q03/duckdb:duckdb 422042981 391727681 1.08
appian_q04/duckdb:duckdb 🚨 1574648482 1316941201 1.20
appian_q05/duckdb:duckdb 🚨 324624595 287112892 1.13
appian_q06/duckdb:duckdb 801234328 791416326 1.01
appian_q07/duckdb:duckdb 348946569 326220738 1.07
appian_q08/duckdb:duckdb 🚨 1401315870 1229225929 1.14
File Size Changes (4 files changed, -0.1% overall, 0↑ 4↓)
File Scale Format Base HEAD Change %
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB 16 B -0.0%
orderview.vortex 1.0 vortex-file-compressed 81.14 MB 81.03 MB 105.46 KB -0.1%
creditcardview.vortex 1.0 vortex-file-compressed 61.09 MB 60.87 MB 224.41 KB -0.4%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.86 MB → 513.54 MB (-0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed +21.9% +10.9% +10.0% +12.3% ➖ noise
1 duckdb:duckdb +12.3% +10.9% +1.2% +10.7% ➖ noise
1 duckdb:vortex-file-compressed +8.5% +10.9% -2.2% +10.7% ➖ noise
2 datafusion:vortex-file-compressed +20.0% +17.6% +2.1% +10.7% ➖ noise
2 duckdb:duckdb +18.1% +17.6% +0.5% +10.7% ➖ noise
2 duckdb:vortex-file-compressed +14.0% +17.6% -3.0% +10.7% ➖ noise
3 datafusion:vortex-file-compressed +23.0% +18.5% +3.8% +10.7% ➖ noise
3 duckdb:duckdb +7.7% +18.5% -9.1% +10.7% ➖ noise
3 duckdb:vortex-file-compressed +20.4% +18.5% +1.5% +10.7% ➖ noise
4 datafusion:vortex-file-compressed +7.5% +12.7% -4.6% +10.7% ➖ noise
4 duckdb:duckdb +19.6% +12.7% +6.1% +10.7% ➖ noise
4 duckdb:vortex-file-compressed +19.7% +12.7% +6.2% +10.7% ➖ noise
5 datafusion:vortex-file-compressed +23.9% +22.1% +1.5% +13.3% ➖ noise
5 duckdb:duckdb +13.1% +22.1% -7.4% +10.7% ➖ noise
5 duckdb:vortex-file-compressed +18.8% +22.1% -2.7% +10.7% ➖ noise
6 datafusion:vortex-file-compressed +19.6% +13.2% +5.7% +10.7% ➖ noise
6 duckdb:duckdb +1.2% +13.2% -10.5% +10.7% ✅ faster
6 duckdb:vortex-file-compressed +11.6% +13.2% -1.3% +10.7% ➖ noise
7 datafusion:vortex-file-compressed +20.3% +10.7% +8.6% +10.7% ➖ noise
7 duckdb:duckdb +7.0% +10.7% -3.4% +10.7% ➖ noise
7 duckdb:vortex-file-compressed +5.7% +10.7% -4.6% +10.7% ➖ noise
8 datafusion:vortex-file-compressed +12.9% +9.2% +3.4% +10.7% ➖ noise
8 duckdb:duckdb +14.0% +9.2% +4.4% +10.7% ➖ noise
8 duckdb:vortex-file-compressed +8.0% +9.2% -1.1% +10.7% ➖ noise

@AdamGS AdamGS changed the title Bump FSST version explicitly Share FSST symbol table state between executed variants of arrays. Jun 2, 2026
@AdamGS AdamGS added the changelog/performance A performance improvement label Jun 2, 2026
@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (-6.8%, environment too noisy confidence) · DuckDB No clear signal (+11.9%, environment too noisy confidence)
Vortex (geomean): 0.930x ➖
Parquet (geomean): 0.911x ➖
Shifts: Parquet (control) -8.9% · Median polish -8.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.934x ➖, 2↑ 1↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 271178378 292745606 0.93
tpch_q02/datafusion:vortex-file-compressed 546898836 599946318 0.91
tpch_q03/datafusion:vortex-file-compressed 461880572 654349674 0.71
tpch_q04/datafusion:vortex-file-compressed 283945094 332897478 0.85
tpch_q05/datafusion:vortex-file-compressed 587394523 534063751 1.10
tpch_q06/datafusion:vortex-file-compressed 377403342 363911139 1.04
tpch_q07/datafusion:vortex-file-compressed 506700046 460085283 1.10
tpch_q08/datafusion:vortex-file-compressed 785050125 719934719 1.09
tpch_q09/datafusion:vortex-file-compressed 580902702 534370640 1.09
tpch_q10/datafusion:vortex-file-compressed 652203843 689995164 0.95
tpch_q11/datafusion:vortex-file-compressed 402972489 352430713 1.14
tpch_q12/datafusion:vortex-file-compressed 546194080 658718208 0.83
tpch_q13/datafusion:vortex-file-compressed 202117857 223393337 0.90
tpch_q14/datafusion:vortex-file-compressed 288813838 353915958 0.82
tpch_q15/datafusion:vortex-file-compressed 552724413 587005760 0.94
tpch_q16/datafusion:vortex-file-compressed 223652460 229211593 0.98
tpch_q17/datafusion:vortex-file-compressed 🚀 454001166 693716139 0.65
tpch_q18/datafusion:vortex-file-compressed 🚀 310227107 446783973 0.69
tpch_q19/datafusion:vortex-file-compressed 470610728 658201894 0.71
tpch_q20/datafusion:vortex-file-compressed 417176182 504803985 0.83
tpch_q21/datafusion:vortex-file-compressed 626845283 668368444 0.94
tpch_q22/datafusion:vortex-file-compressed 🚨 214516405 111950425 1.92
datafusion / vortex-compact (0.859x ➖, 4↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 263501458 278143386 0.95
tpch_q02/datafusion:vortex-compact 444567967 525932757 0.85
tpch_q03/datafusion:vortex-compact 🚀 393417460 643760419 0.61
tpch_q04/datafusion:vortex-compact 215798170 237724332 0.91
tpch_q05/datafusion:vortex-compact 🚀 370139125 543926469 0.68
tpch_q06/datafusion:vortex-compact 322580560 330344589 0.98
tpch_q07/datafusion:vortex-compact 526444954 498782184 1.06
tpch_q08/datafusion:vortex-compact 556562742 616280069 0.90
tpch_q09/datafusion:vortex-compact 438673681 482205574 0.91
tpch_q10/datafusion:vortex-compact 583469697 677314909 0.86
tpch_q11/datafusion:vortex-compact 260142996 356561909 0.73
tpch_q12/datafusion:vortex-compact 386184021 419794263 0.92
tpch_q13/datafusion:vortex-compact 138680768 149275038 0.93
tpch_q14/datafusion:vortex-compact 🚀 224652340 331910602 0.68
tpch_q15/datafusion:vortex-compact 🚀 387121775 618597895 0.63
tpch_q16/datafusion:vortex-compact 180839651 215598828 0.84
tpch_q17/datafusion:vortex-compact 337832004 439134568 0.77
tpch_q18/datafusion:vortex-compact 297071425 354125064 0.84
tpch_q19/datafusion:vortex-compact 491812390 486067598 1.01
tpch_q20/datafusion:vortex-compact 441424823 465060375 0.95
tpch_q21/datafusion:vortex-compact 853539686 821593677 1.04
tpch_q22/datafusion:vortex-compact 223913318 201432674 1.11
datafusion / parquet (0.961x ➖, 1↑ 2↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 244485394 243235085 1.01
tpch_q02/datafusion:parquet 460621169 447847503 1.03
tpch_q03/datafusion:parquet 364414564 386109228 0.94
tpch_q04/datafusion:parquet 235434294 202584380 1.16
tpch_q05/datafusion:parquet 528641417 567090680 0.93
tpch_q06/datafusion:parquet 220640154 242947038 0.91
tpch_q07/datafusion:parquet 574391389 634917905 0.90
tpch_q08/datafusion:parquet 648210642 740518284 0.88
tpch_q09/datafusion:parquet 562089770 608221294 0.92
tpch_q10/datafusion:parquet 554515217 625728610 0.89
tpch_q11/datafusion:parquet 363676913 369479338 0.98
tpch_q12/datafusion:parquet 284916812 259563119 1.10
tpch_q13/datafusion:parquet 477646423 450239014 1.06
tpch_q14/datafusion:parquet 241653914 266520922 0.91
tpch_q15/datafusion:parquet 🚨 502402321 381234519 1.32
tpch_q16/datafusion:parquet 🚨 325227672 207351641 1.57
tpch_q17/datafusion:parquet 487906638 514236118 0.95
tpch_q18/datafusion:parquet 🚀 470764946 787872833 0.60
tpch_q19/datafusion:parquet 381296564 460517273 0.83
tpch_q20/datafusion:parquet 324511926 391091497 0.83
tpch_q21/datafusion:parquet 674210613 612499704 1.10
tpch_q22/datafusion:parquet 133525944 183139700 0.73
duckdb / vortex-file-compressed (0.913x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 260917506 307999935 0.85
tpch_q02/duckdb:vortex-file-compressed 999309619 1065882516 0.94
tpch_q03/duckdb:vortex-file-compressed 729979133 767132463 0.95
tpch_q04/duckdb:vortex-file-compressed 471749125 546071129 0.86
tpch_q05/duckdb:vortex-file-compressed 786850966 967760208 0.81
tpch_q06/duckdb:vortex-file-compressed 363014415 428111741 0.85
tpch_q07/duckdb:vortex-file-compressed 968539805 1010053530 0.96
tpch_q08/duckdb:vortex-file-compressed 981266989 1139447393 0.86
tpch_q09/duckdb:vortex-file-compressed 943224798 949710481 0.99
tpch_q10/duckdb:vortex-file-compressed 797572187 850383347 0.94
tpch_q11/duckdb:vortex-file-compressed 474177798 572539436 0.83
tpch_q12/duckdb:vortex-file-compressed 651866677 702044149 0.93
tpch_q13/duckdb:vortex-file-compressed 372444913 467453640 0.80
tpch_q14/duckdb:vortex-file-compressed 449292434 439301758 1.02
tpch_q15/duckdb:vortex-file-compressed 331852477 316876858 1.05
tpch_q16/duckdb:vortex-file-compressed 362641354 408896222 0.89
tpch_q17/duckdb:vortex-file-compressed 703060187 858308045 0.82
tpch_q18/duckdb:vortex-file-compressed 604731846 714161069 0.85
tpch_q19/duckdb:vortex-file-compressed 572477159 503229878 1.14
tpch_q20/duckdb:vortex-file-compressed 821066735 924813047 0.89
tpch_q21/duckdb:vortex-file-compressed 1237347033 1111318405 1.11
tpch_q22/duckdb:vortex-file-compressed 245340582 287429773 0.85
duckdb / vortex-compact (1.023x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 348514296 344789474 1.01
tpch_q02/duckdb:vortex-compact 1020548776 999842116 1.02
tpch_q03/duckdb:vortex-compact 724465731 629752608 1.15
tpch_q04/duckdb:vortex-compact 475127801 504151733 0.94
tpch_q05/duckdb:vortex-compact 878719401 839442336 1.05
tpch_q06/duckdb:vortex-compact 509002019 399609902 1.27
tpch_q07/duckdb:vortex-compact 996791646 887039094 1.12
tpch_q08/duckdb:vortex-compact 1102370143 1066361257 1.03
tpch_q09/duckdb:vortex-compact 1019837973 1181065099 0.86
tpch_q10/duckdb:vortex-compact 748562173 783829832 0.96
tpch_q11/duckdb:vortex-compact 549513393 567988019 0.97
tpch_q12/duckdb:vortex-compact 685599959 685284486 1.00
tpch_q13/duckdb:vortex-compact 467388971 406762250 1.15
tpch_q14/duckdb:vortex-compact 448202856 404020661 1.11
tpch_q15/duckdb:vortex-compact 394624567 360135214 1.10
tpch_q16/duckdb:vortex-compact 368313573 342620553 1.07
tpch_q17/duckdb:vortex-compact 740575691 709798051 1.04
tpch_q18/duckdb:vortex-compact 494857087 589891424 0.84
tpch_q19/duckdb:vortex-compact 512623256 518538536 0.99
tpch_q20/duckdb:vortex-compact 780479273 860198032 0.91
tpch_q21/duckdb:vortex-compact 1021456075 1077701347 0.95
tpch_q22/duckdb:vortex-compact 309438297 292265958 1.06
duckdb / parquet (0.863x ➖, 1↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 429360766 556749902 0.77
tpch_q02/duckdb:parquet 1222172370 1192226649 1.03
tpch_q03/duckdb:parquet 1129769213 1177774288 0.96
tpch_q04/duckdb:parquet 633675994 736523506 0.86
tpch_q05/duckdb:parquet 1197765783 1485825337 0.81
tpch_q06/duckdb:parquet 434869071 493241355 0.88
tpch_q07/duckdb:parquet 1184663386 1387319582 0.85
tpch_q08/duckdb:parquet 1505289735 1945227184 0.77
tpch_q09/duckdb:parquet 🚀 1270902805 1827696218 0.70
tpch_q10/duckdb:parquet 1404608597 1427903880 0.98
tpch_q11/duckdb:parquet 688412980 850995337 0.81
tpch_q12/duckdb:parquet 736901599 895939570 0.82
tpch_q13/duckdb:parquet 901368392 1034457094 0.87
tpch_q14/duckdb:parquet 753118947 880345346 0.86
tpch_q15/duckdb:parquet 545816109 598325699 0.91
tpch_q16/duckdb:parquet 627006515 758035252 0.83
tpch_q17/duckdb:parquet 748167492 892651572 0.84
tpch_q18/duckdb:parquet 877095400 1026470342 0.85
tpch_q19/duckdb:parquet 838827909 945985268 0.89
tpch_q20/duckdb:parquet 1093782196 1213886416 0.90
tpch_q21/duckdb:parquet 1130754849 1257370620 0.90
tpch_q22/duckdb:parquet 585238972 600561114 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.3% -12.0% +7.6% +82.5% ➖ noise
1 datafusion:vortex-file-compressed -7.4% -12.0% +5.2% +75.8% ➖ noise
1 duckdb:vortex-compact +1.1% -12.0% +14.8% +45.7% ➖ noise
1 duckdb:vortex-file-compressed -15.3% -12.0% -3.8% +63.6% ➖ noise
2 datafusion:vortex-compact -15.5% +2.7% -17.7% +30.8% ➖ noise
2 datafusion:vortex-file-compressed -8.8% +2.7% -11.2% +32.2% ➖ noise
2 duckdb:vortex-compact +2.1% +2.7% -0.6% +30.8% ➖ noise
2 duckdb:vortex-file-compressed -6.2% +2.7% -8.7% +30.8% ➖ noise
3 datafusion:vortex-compact -38.9% -4.9% -35.8% +48.7% ✅ faster
3 datafusion:vortex-file-compressed -29.4% -4.9% -25.8% +62.5% ➖ noise
3 duckdb:vortex-compact +15.0% -4.9% +20.9% +37.7% ➖ noise
3 duckdb:vortex-file-compressed -4.8% -4.9% +0.0% +30.8% ➖ noise
4 datafusion:vortex-compact -9.2% -0.0% -9.2% +35.3% ➖ noise
4 datafusion:vortex-file-compressed -14.7% -0.0% -14.7% +30.8% ➖ noise
4 duckdb:vortex-compact -5.8% -0.0% -5.8% +30.8% ➖ noise
4 duckdb:vortex-file-compressed -13.6% -0.0% -13.6% +30.8% ➖ noise
5 datafusion:vortex-compact -32.0% -13.3% -21.5% +36.1% ➖ noise
5 datafusion:vortex-file-compressed +10.0% -13.3% +26.9% +106.7% ➖ noise
5 duckdb:vortex-compact +4.7% -13.3% +20.8% +32.4% ➖ noise
5 duckdb:vortex-file-compressed -18.7% -13.3% -6.2% +30.8% ➖ noise
6 datafusion:vortex-compact -2.4% -10.5% +9.1% +30.8% ➖ noise
6 datafusion:vortex-file-compressed +3.7% -10.5% +15.9% +30.8% ➖ noise
6 duckdb:vortex-compact +27.4% -10.5% +42.3% +30.8% 🚨 regression
6 duckdb:vortex-file-compressed -15.2% -10.5% -5.2% +30.8% ➖ noise
7 datafusion:vortex-compact +5.5% -12.1% +20.1% +39.8% ➖ noise
7 datafusion:vortex-file-compressed +10.1% -12.1% +25.3% +30.8% ➖ noise
7 duckdb:vortex-compact +12.4% -12.1% +27.9% +30.8% ➖ noise
7 duckdb:vortex-file-compressed -4.1% -12.1% +9.1% +30.8% ➖ noise
8 datafusion:vortex-compact -9.7% -17.7% +9.7% +30.8% ➖ noise
8 datafusion:vortex-file-compressed +9.0% -17.7% +32.5% +30.8% 🚨 regression
8 duckdb:vortex-compact +3.4% -17.7% +25.6% +43.2% ➖ noise
8 duckdb:vortex-file-compressed -13.9% -17.7% +4.6% +30.8% ➖ noise
9 datafusion:vortex-compact -9.0% -19.8% +13.5% +30.8% ➖ noise
9 datafusion:vortex-file-compressed +8.7% -19.8% +35.6% +30.8% 🚨 regression
9 duckdb:vortex-compact -13.7% -19.8% +7.7% +30.8% ➖ noise
9 duckdb:vortex-file-compressed -0.7% -19.8% +23.9% +30.8% ➖ noise
10 datafusion:vortex-compact -13.9% -6.6% -7.7% +32.0% ➖ noise
10 datafusion:vortex-file-compressed -5.5% -6.6% +1.2% +30.8% ➖ noise
10 duckdb:vortex-compact -4.5% -6.6% +2.3% +30.8% ➖ noise
10 duckdb:vortex-file-compressed -6.2% -6.6% +0.5% +30.8% ➖ noise
11 datafusion:vortex-compact -27.0% -10.8% -18.2% +30.8% ➖ noise
11 datafusion:vortex-file-compressed +14.3% -10.8% +28.1% +32.4% ➖ noise
11 duckdb:vortex-compact -3.3% -10.8% +8.4% +30.8% ➖ noise
11 duckdb:vortex-file-compressed -17.2% -10.8% -7.2% +30.8% ➖ noise
12 datafusion:vortex-compact -8.0% -5.0% -3.2% +45.7% ➖ noise
12 datafusion:vortex-file-compressed -17.1% -5.0% -12.7% +40.8% ➖ noise
12 duckdb:vortex-compact +0.0% -5.0% +5.3% +44.4% ➖ noise
12 duckdb:vortex-file-compressed -7.1% -5.0% -2.3% +39.9% ➖ noise
13 datafusion:vortex-compact -7.1% -3.9% -3.4% +50.6% ➖ noise
13 datafusion:vortex-file-compressed -9.5% -3.9% -5.9% +51.6% ➖ noise
13 duckdb:vortex-compact +14.9% -3.9% +19.5% +31.6% ➖ noise
13 duckdb:vortex-file-compressed -20.3% -3.9% -17.1% +32.8% ➖ noise
14 datafusion:vortex-compact -32.3% -11.9% -23.1% +36.9% ➖ noise
14 datafusion:vortex-file-compressed -18.4% -11.9% -7.3% +33.8% ➖ noise
14 duckdb:vortex-compact +10.9% -11.9% +26.0% +38.9% ➖ noise
14 duckdb:vortex-file-compressed +2.3% -11.9% +16.1% +32.8% ➖ noise
15 datafusion:vortex-compact -37.4% +9.6% -42.9% +30.8% ✅ faster
15 datafusion:vortex-file-compressed -5.8% +9.6% -14.1% +30.8% ➖ noise
15 duckdb:vortex-compact +9.6% +9.6% -0.1% +41.6% ➖ noise
15 duckdb:vortex-file-compressed +4.7% +9.6% -4.5% +30.8% ➖ noise
16 datafusion:vortex-compact -16.1% +13.9% -26.4% +30.8% ✅ faster
16 datafusion:vortex-file-compressed -2.4% +13.9% -14.3% +30.8% ➖ noise
16 duckdb:vortex-compact +7.5% +13.9% -5.6% +30.8% ➖ noise
16 duckdb:vortex-file-compressed -11.3% +13.9% -22.1% +30.8% ➖ noise
17 datafusion:vortex-compact -23.1% -10.8% -13.7% +30.8% ➖ noise
17 datafusion:vortex-file-compressed -34.6% -10.8% -26.6% +30.8% ✅ faster
17 duckdb:vortex-compact +4.3% -10.8% +17.0% +30.8% ➖ noise
17 duckdb:vortex-file-compressed -18.1% -10.8% -8.1% +30.8% ➖ noise
18 datafusion:vortex-compact -16.1% -28.5% +17.4% +30.8% ➖ noise
18 datafusion:vortex-file-compressed -30.6% -28.5% -2.8% +30.8% ➖ noise
18 duckdb:vortex-compact -16.1% -28.5% +17.4% +30.8% ➖ noise
18 duckdb:vortex-file-compressed -15.3% -28.5% +18.5% +30.8% ➖ noise
19 datafusion:vortex-compact +1.2% -14.3% +18.1% +30.8% ➖ noise
19 datafusion:vortex-file-compressed -28.5% -14.3% -16.6% +30.8% ➖ noise
19 duckdb:vortex-compact -1.1% -14.3% +15.4% +30.8% ➖ noise
19 duckdb:vortex-file-compressed +13.8% -14.3% +32.8% +30.8% 🚨 regression
20 datafusion:vortex-compact -5.1% -13.5% +9.8% +30.8% ➖ noise
20 datafusion:vortex-file-compressed -17.4% -13.5% -4.4% +30.8% ➖ noise
20 duckdb:vortex-compact -9.3% -13.5% +4.9% +30.8% ➖ noise
20 duckdb:vortex-file-compressed -11.2% -13.5% +2.7% +30.8% ➖ noise
21 datafusion:vortex-compact +3.9% -0.5% +4.4% +30.8% ➖ noise
21 datafusion:vortex-file-compressed -6.2% -0.5% -5.7% +30.8% ➖ noise
21 duckdb:vortex-compact -5.2% -0.5% -4.7% +30.8% ➖ noise
21 duckdb:vortex-file-compressed +11.3% -0.5% +11.9% +30.8% ➖ noise
22 datafusion:vortex-compact +11.2% -15.7% +31.9% +47.5% ➖ noise
22 datafusion:vortex-file-compressed +91.6% -15.7% +127.3% +43.2% 🚨 regression
22 duckdb:vortex-compact +5.9% -15.7% +25.6% +30.8% ➖ noise
22 duckdb:vortex-file-compressed -14.6% -15.7% +1.3% +30.8% ➖ noise

@AdamGS AdamGS requested review from a10y, joseph-isaacs and robert3005 and removed request for joseph-isaacs June 2, 2026 16:31
@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.020x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.026x ➖, 2↑ 10↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
compress time/Arade 1169754231 1122545997 1.04
compress time/Bimbo 5949639016 5737345415 1.04
compress time/CMSprovider 2856342339 2803660027 1.02
compress time/Euro2016 491801103 474101104 1.04
compress time/Food 399133749 378020302 1.06
compress time/HashTags 876399219 867949852 1.01
compress time/TPC-H l_comment canonical 1311920156 1223217382 1.07
compress time/TPC-H l_comment chunked 1322502652 1228626644 1.08
compress time/taxi 723586354 684081095 1.06
compress time/wide table cols=100 chunks=1 rows=1000 11803444 11799019 1.00
compress time/wide table cols=100 chunks=50 rows=1000 12395306 11602696 1.07
compress time/wide table cols=1000 chunks=1 rows=1000 130203808 127708516 1.02
compress time/wide table cols=1000 chunks=50 rows=1000 131221800 122514462 1.07
compress time/wide table cols=10000 chunks=1 rows=1000 1503577351 1436699829 1.05
compress time/wide table cols=10000 chunks=50 rows=1000 1535859832 1483156411 1.04
decompress time/Arade 26270768 26337892 1.00
decompress time/Bimbo 🚨 85879234 77493975 1.11
decompress time/CMSprovider 🚨 83616500 75434896 1.11
decompress time/Euro2016 20122379 19479573 1.03
decompress time/Food 8550307 8069280 1.06
decompress time/HashTags 93590102 92735220 1.01
decompress time/TPC-H l_comment canonical 41049762 39923137 1.03
decompress time/TPC-H l_comment chunked 43519122 40093139 1.09
decompress time/taxi 15750186 15448091 1.02
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2878359 2418930 1.19
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2886054 2474498 1.17
decompress time/wide table cols=1000 chunks=1 rows=1000 24951968 23050889 1.08
decompress time/wide table cols=1000 chunks=50 rows=1000 26047527 23817694 1.09
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 282615922 250085063 1.13
decompress time/wide table cols=10000 chunks=50 rows=1000 276289653 263406229 1.05
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2687664434 2598468594 1.03
parquet_rs-zstd compress time/Bimbo 12937841296 12677418847 1.02
parquet_rs-zstd compress time/CMSprovider 7312176255 6840609985 1.07
parquet_rs-zstd compress time/Euro2016 1350902878 1314532056 1.03
parquet_rs-zstd compress time/Food 818014293 802942723 1.02
parquet_rs-zstd compress time/HashTags 2310927418 2203419871 1.05
parquet_rs-zstd compress time/TPC-H l_comment canonical 3334793560 3206963357 1.04
parquet_rs-zstd compress time/TPC-H l_comment chunked 3334236706 3209556476 1.04
parquet_rs-zstd compress time/taxi 1249315107 1192134191 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 6905019 5978798 1.15
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7134595 6041640 1.18
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 78884908 74198588 1.06
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 79092090 75147846 1.05
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 815403872 767035389 1.06
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 814877525 799391738 1.02
parquet_rs-zstd decompress time/Arade 636919092 618385453 1.03
parquet_rs-zstd decompress time/Bimbo 1714717913 1695370937 1.01
parquet_rs-zstd decompress time/CMSprovider 1776393109 1707191328 1.04
parquet_rs-zstd decompress time/Euro2016 390723428 379093344 1.03
parquet_rs-zstd decompress time/Food 203225991 196981387 1.03
parquet_rs-zstd decompress time/HashTags 🚨 731684577 644728338 1.13
parquet_rs-zstd decompress time/TPC-H l_comment canonical 622081155 589228464 1.06
parquet_rs-zstd decompress time/TPC-H l_comment chunked 619179548 588051464 1.05
parquet_rs-zstd decompress time/taxi 251511228 244878911 1.03
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2956020 2768079 1.07
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2928660 2783206 1.05
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34579724 31756942 1.09
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 34494919 33109503 1.04
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 354329598 344247201 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 356861664 350096914 1.02
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417903972 417905492 1.00
vortex-file-compressed size/Euro2016 158826916 158190388 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185756956 185007124 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178410360 178402152 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178506664 178355072 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.95
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio compress time/Food 0 0 1.04
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio compress time/taxi 0 0 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.87
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.90
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.97
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.10
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.07
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio decompress time/Food 0 0 1.03
vortex:parquet-zstd ratio decompress time/HashTags 🚀 0 0 0.89
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.97
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@AdamGS
Share FSST compressor between arrays
afd4751 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/bump-fsst branch from e5f6e43 to afd4751 Compare June 2, 2026 16:40
@github-actions

github-actions Bot commented Jun 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.0%
Engines: DataFusion No clear signal (+7.1%, environment too noisy confidence) · DuckDB No clear signal (+3.0%, environment too noisy confidence)
Vortex (geomean): 1.010x ➖
Parquet (geomean): 0.962x ➖
Shifts: Parquet (control) -3.8% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.919x ➖, 2↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 713333396 694550975 1.03
tpch_q02/datafusion:vortex-file-compressed 752014205 820125791 0.92
tpch_q03/datafusion:vortex-file-compressed 842089481 993602418 0.85
tpch_q04/datafusion:vortex-file-compressed 688538007 734667243 0.94
tpch_q05/datafusion:vortex-file-compressed 1035137039 1082166433 0.96
tpch_q06/datafusion:vortex-file-compressed 611131024 641966844 0.95
tpch_q07/datafusion:vortex-file-compressed 1058451432 1212408617 0.87
tpch_q08/datafusion:vortex-file-compressed 1288808582 1289187180 1.00
tpch_q09/datafusion:vortex-file-compressed 1383899848 1358843196 1.02
tpch_q10/datafusion:vortex-file-compressed 1053432072 1020841967 1.03
tpch_q11/datafusion:vortex-file-compressed 478704099 600891165 0.80
tpch_q12/datafusion:vortex-file-compressed 919898473 848288615 1.08
tpch_q13/datafusion:vortex-file-compressed 466187581 448529395 1.04
tpch_q14/datafusion:vortex-file-compressed 554314509 525545602 1.05
tpch_q15/datafusion:vortex-file-compressed 1010393457 964193608 1.05
tpch_q16/datafusion:vortex-file-compressed 465099346 396897413 1.17
tpch_q17/datafusion:vortex-file-compressed 🚀 1209932066 1768590816 0.68
tpch_q18/datafusion:vortex-file-compressed 🚀 1392344098 2123074163 0.66
tpch_q19/datafusion:vortex-file-compressed 849176112 1134291182 0.75
tpch_q20/datafusion:vortex-file-compressed 932147048 1082714246 0.86
tpch_q21/datafusion:vortex-file-compressed 1846540433 1765078724 1.05
tpch_q22/datafusion:vortex-file-compressed 444344978 628953924 0.71
datafusion / vortex-compact (0.974x ➖, 3↑ 2↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 735496244 741483094 0.99
tpch_q02/datafusion:vortex-compact 832389295 928113799 0.90
tpch_q03/datafusion:vortex-compact 820592558 963959469 0.85
tpch_q04/datafusion:vortex-compact 534029222 570178021 0.94
tpch_q05/datafusion:vortex-compact 1060919884 998067730 1.06
tpch_q06/datafusion:vortex-compact 603639524 642430381 0.94
tpch_q07/datafusion:vortex-compact 1167800856 1056831014 1.11
tpch_q08/datafusion:vortex-compact 1285292563 1254318172 1.02
tpch_q09/datafusion:vortex-compact 1337379690 1370533210 0.98
tpch_q10/datafusion:vortex-compact 900303119 1042448825 0.86
tpch_q11/datafusion:vortex-compact 🚀 437881659 679479123 0.64
tpch_q12/datafusion:vortex-compact 🚀 857759760 1406848919 0.61
tpch_q13/datafusion:vortex-compact 412861320 424711371 0.97
tpch_q14/datafusion:vortex-compact 🚀 532346204 819354408 0.65
tpch_q15/datafusion:vortex-compact 999417490 1115064653 0.90
tpch_q16/datafusion:vortex-compact 🚨 760745961 462276074 1.65
tpch_q17/datafusion:vortex-compact 1260099317 1125788291 1.12
tpch_q18/datafusion:vortex-compact 1249010038 1223836565 1.02
tpch_q19/datafusion:vortex-compact 1020561499 891117617 1.15
tpch_q20/datafusion:vortex-compact 1108751656 984508595 1.13
tpch_q21/datafusion:vortex-compact 1781793036 1565029230 1.14
tpch_q22/datafusion:vortex-compact 🚨 771676194 565582625 1.36
datafusion / parquet (0.883x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 914805868 846954655 1.08
tpch_q02/datafusion:parquet 1040648939 1082336298 0.96
tpch_q03/datafusion:parquet 933952875 1212170659 0.77
tpch_q04/datafusion:parquet 490690911 564561932 0.87
tpch_q05/datafusion:parquet 1273769160 1504657910 0.85
tpch_q06/datafusion:parquet 581890565 790237548 0.74
tpch_q07/datafusion:parquet 1445589144 1541070577 0.94
tpch_q08/datafusion:parquet 1581699123 2058548837 0.77
tpch_q09/datafusion:parquet 1777604932 1915913426 0.93
tpch_q10/datafusion:parquet 2177807427 2783893682 0.78
tpch_q11/datafusion:parquet 635543755 697155640 0.91
tpch_q12/datafusion:parquet 674952706 863854287 0.78
tpch_q13/datafusion:parquet 678594016 775602533 0.87
tpch_q14/datafusion:parquet 784988679 897059732 0.88
tpch_q15/datafusion:parquet 1393038934 1487856613 0.94
tpch_q16/datafusion:parquet 631898468 585502451 1.08
tpch_q17/datafusion:parquet 1423103526 1402364592 1.01
tpch_q18/datafusion:parquet 1723608057 1761474960 0.98
tpch_q19/datafusion:parquet 901529491 1033679825 0.87
tpch_q20/datafusion:parquet 1142945004 1571200369 0.73
tpch_q21/datafusion:parquet 1720688605 2066586447 0.83
tpch_q22/datafusion:parquet 1066198508 1073038578 0.99
duckdb / vortex-file-compressed (1.082x ➖, 0↑ 1↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 673931358 652140165 1.03
tpch_q02/duckdb:vortex-file-compressed 1378551954 1203716676 1.15
tpch_q03/duckdb:vortex-file-compressed 1093140724 990375077 1.10
tpch_q04/duckdb:vortex-file-compressed 840366971 855970978 0.98
tpch_q05/duckdb:vortex-file-compressed 1335213598 1366308979 0.98
tpch_q06/duckdb:vortex-file-compressed 648433836 580714885 1.12
tpch_q07/duckdb:vortex-file-compressed 1373904381 1287291150 1.07
tpch_q08/duckdb:vortex-file-compressed 1575006981 1705455191 0.92
tpch_q09/duckdb:vortex-file-compressed 1956477525 1915736418 1.02
tpch_q10/duckdb:vortex-file-compressed 1339884833 1452829162 0.92
tpch_q11/duckdb:vortex-file-compressed 855668279 707939771 1.21
tpch_q12/duckdb:vortex-file-compressed 1399234280 1340921496 1.04
tpch_q13/duckdb:vortex-file-compressed 891033532 875565943 1.02
tpch_q14/duckdb:vortex-file-compressed 804306662 700988954 1.15
tpch_q15/duckdb:vortex-file-compressed 666447443 572323592 1.16
tpch_q16/duckdb:vortex-file-compressed 576266670 565825196 1.02
tpch_q17/duckdb:vortex-file-compressed 1088757715 1048882904 1.04
tpch_q18/duckdb:vortex-file-compressed 1169134989 943440261 1.24
tpch_q19/duckdb:vortex-file-compressed 902836718 789182597 1.14
tpch_q20/duckdb:vortex-file-compressed 1535601330 1299362110 1.18
tpch_q21/duckdb:vortex-file-compressed 2221038890 2072937468 1.07
tpch_q22/duckdb:vortex-file-compressed 🚨 578468417 434796499 1.33
duckdb / vortex-compact (1.075x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 644245496 622711667 1.03
tpch_q02/duckdb:vortex-compact 1255847490 1158320684 1.08
tpch_q03/duckdb:vortex-compact 911640890 983802910 0.93
tpch_q04/duckdb:vortex-compact 658885176 665567486 0.99
tpch_q05/duckdb:vortex-compact 1349143123 1252838578 1.08
tpch_q06/duckdb:vortex-compact 634609874 561217882 1.13
tpch_q07/duckdb:vortex-compact 1291923900 1182863893 1.09
tpch_q08/duckdb:vortex-compact 1602276200 1463656624 1.09
tpch_q09/duckdb:vortex-compact 1724134622 1714135458 1.01
tpch_q10/duckdb:vortex-compact 1355088356 1425018883 0.95
tpch_q11/duckdb:vortex-compact 783729336 758747006 1.03
tpch_q12/duckdb:vortex-compact 1116165324 1111229434 1.00
tpch_q13/duckdb:vortex-compact 913755002 796651429 1.15
tpch_q14/duckdb:vortex-compact 767619120 655258187 1.17
tpch_q15/duckdb:vortex-compact 629503967 515917925 1.22
tpch_q16/duckdb:vortex-compact 462766017 491266524 0.94
tpch_q17/duckdb:vortex-compact 1075045060 961047744 1.12
tpch_q18/duckdb:vortex-compact 1017371868 945994212 1.08
tpch_q19/duckdb:vortex-compact 900665525 804044440 1.12
tpch_q20/duckdb:vortex-compact 1441553254 1317291627 1.09
tpch_q21/duckdb:vortex-compact 1954088525 1765300151 1.11
tpch_q22/duckdb:vortex-compact 599001955 461309286 1.30
duckdb / parquet (1.047x ➖, 0↑ 0↓)
name PR afd4751 (ns) base 84a4a3f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1040854898 864508835 1.20
tpch_q02/duckdb:parquet 1480885240 1526170722 0.97
tpch_q03/duckdb:parquet 1928739220 1771204466 1.09
tpch_q04/duckdb:parquet 1155822099 1144006931 1.01
tpch_q05/duckdb:parquet 2079795112 2069072829 1.01
tpch_q06/duckdb:parquet 853673078 889567002 0.96
tpch_q07/duckdb:parquet 2015220051 2003314491 1.01
tpch_q08/duckdb:parquet 2642214530 2560444643 1.03
tpch_q09/duckdb:parquet 2745397223 2880703180 0.95
tpch_q10/duckdb:parquet 3693451529 3210011463 1.15
tpch_q11/duckdb:parquet 1203217771 1026794452 1.17
tpch_q12/duckdb:parquet 1624208558 1259258229 1.29
tpch_q13/duckdb:parquet 1327585787 1313678131 1.01
tpch_q14/duckdb:parquet 1507028346 1331623604 1.13
tpch_q15/duckdb:parquet 977293947 993731567 0.98
tpch_q16/duckdb:parquet 1045094470 995639735 1.05
tpch_q17/duckdb:parquet 1395376118 1505467884 0.93
tpch_q18/duckdb:parquet 1660032336 1557437248 1.07
tpch_q19/duckdb:parquet 1595601192 1444238779 1.10
tpch_q20/duckdb:parquet 2163345308 2246420192 0.96
tpch_q21/duckdb:parquet 1967479790 1939259818 1.01
tpch_q22/duckdb:parquet 1219668415 1191290569 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -0.8% +14.0% -13.0% +42.8% ➖ noise
1 datafusion:vortex-file-compressed +2.7% +14.0% -9.9% +43.2% ➖ noise
1 duckdb:vortex-compact +3.5% +14.0% -9.3% +34.3% ➖ noise
1 duckdb:vortex-file-compressed +3.3% +14.0% -9.4% +33.6% ➖ noise
2 datafusion:vortex-compact -10.3% -3.4% -7.1% +38.3% ➖ noise
2 datafusion:vortex-file-compressed -8.3% -3.4% -5.1% +33.6% ➖ noise
2 duckdb:vortex-compact +8.4% -3.4% +12.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +14.5% -3.4% +18.6% +31.8% ➖ noise
3 datafusion:vortex-compact -14.9% -8.4% -7.1% +44.8% ➖ noise
3 datafusion:vortex-file-compressed -15.2% -8.4% -7.5% +44.4% ➖ noise
3 duckdb:vortex-compact -7.3% -8.4% +1.2% +44.0% ➖ noise
3 duckdb:vortex-file-compressed +10.4% -8.4% +20.5% +38.8% ➖ noise
4 datafusion:vortex-compact -6.3% -6.3% -0.1% +33.2% ➖ noise
4 datafusion:vortex-file-compressed -6.3% -6.3% +0.0% +30.3% ➖ noise
4 duckdb:vortex-compact -1.0% -6.3% +5.6% +33.3% ➖ noise
4 duckdb:vortex-file-compressed -1.8% -6.3% +4.8% +30.0% ➖ noise
5 datafusion:vortex-compact +6.3% -7.8% +15.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -4.3% -7.8% +3.7% +30.0% ➖ noise
5 duckdb:vortex-compact +7.7% -7.8% +16.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.3% -7.8% +5.9% +30.0% ➖ noise
6 datafusion:vortex-compact -6.0% -15.9% +11.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -4.8% -15.9% +13.2% +30.0% ➖ noise
6 duckdb:vortex-compact +13.1% -15.9% +34.5% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed +11.7% -15.9% +32.8% +30.0% 🚨 regression
7 datafusion:vortex-compact +10.5% -2.9% +13.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -12.7% -2.9% -10.1% +30.0% ➖ noise
7 duckdb:vortex-compact +9.2% -2.9% +12.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +6.7% -2.9% +9.9% +30.0% ➖ noise
8 datafusion:vortex-compact +2.5% -11.0% +15.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -0.0% -11.0% +12.3% +30.0% ➖ noise
8 duckdb:vortex-compact +9.5% -11.0% +22.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -7.6% -11.0% +3.7% +30.0% ➖ noise
9 datafusion:vortex-compact -2.4% -6.0% +3.8% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +1.8% -6.0% +8.3% +30.0% ➖ noise
9 duckdb:vortex-compact +0.6% -6.0% +7.0% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +2.1% -6.0% +8.6% +30.0% ➖ noise
10 datafusion:vortex-compact -13.6% -5.1% -9.0% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +3.2% -5.1% +8.8% +30.0% ➖ noise
10 duckdb:vortex-compact -4.9% -5.1% +0.2% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -7.8% -5.1% -2.8% +30.0% ➖ noise
11 datafusion:vortex-compact -35.6% +3.4% -37.6% +30.0% ✅ faster
11 datafusion:vortex-file-compressed -20.3% +3.4% -22.9% +30.0% ➖ noise
11 duckdb:vortex-compact +3.3% +3.4% -0.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +20.9% +3.4% +16.9% +42.1% ➖ noise
12 datafusion:vortex-compact -39.0% +0.4% -39.3% +30.0% ✅ faster
12 datafusion:vortex-file-compressed +8.4% +0.4% +8.0% +30.0% ➖ noise
12 duckdb:vortex-compact +0.4% +0.4% +0.1% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +4.3% +0.4% +3.9% +30.0% ➖ noise
13 datafusion:vortex-compact -2.8% -6.0% +3.4% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +3.9% -6.0% +10.5% +32.9% ➖ noise
13 duckdb:vortex-compact +14.7% -6.0% +22.0% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +1.8% -6.0% +8.2% +30.0% ➖ noise
14 datafusion:vortex-compact -35.0% -0.5% -34.7% +30.0% ✅ faster
14 datafusion:vortex-file-compressed +5.5% -0.5% +6.0% +30.0% ➖ noise
14 duckdb:vortex-compact +17.1% -0.5% +17.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +14.7% -0.5% +15.3% +30.0% ➖ noise
15 datafusion:vortex-compact -10.4% -4.0% -6.6% +59.2% ➖ noise
15 datafusion:vortex-file-compressed +4.8% -4.0% +9.2% +54.7% ➖ noise
15 duckdb:vortex-compact +22.0% -4.0% +27.2% +54.7% ➖ noise
15 duckdb:vortex-file-compressed +16.4% -4.0% +21.4% +56.3% ➖ noise
16 datafusion:vortex-compact +64.6% +6.4% +54.6% +34.2% 🚨 regression
16 datafusion:vortex-file-compressed +17.2% +6.4% +10.1% +30.0% ➖ noise
16 duckdb:vortex-compact -5.8% +6.4% -11.5% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +1.8% +6.4% -4.3% +30.0% ➖ noise
17 datafusion:vortex-compact +11.9% -3.0% +15.4% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -31.6% -3.0% -29.5% +30.0% ✅ faster
17 duckdb:vortex-compact +11.9% -3.0% +15.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +3.8% -3.0% +7.0% +30.0% ➖ noise
18 datafusion:vortex-compact +2.1% +2.1% -0.1% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -34.4% +2.1% -35.8% +35.7% ✅ faster
18 duckdb:vortex-compact +7.5% +2.1% +5.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +23.9% +2.1% +21.3% +30.0% ➖ noise
19 datafusion:vortex-compact +14.5% -1.8% +16.7% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -25.1% -1.8% -23.7% +32.4% ➖ noise
19 duckdb:vortex-compact +12.0% -1.8% +14.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +14.4% -1.8% +16.5% +30.0% ➖ noise
20 datafusion:vortex-compact +12.6% -16.3% +34.6% +30.0% 🚨 regression
20 datafusion:vortex-file-compressed -13.9% -16.3% +2.9% +30.0% ➖ noise
20 duckdb:vortex-compact +9.4% -16.3% +30.7% +30.0% 🚨 regression
20 duckdb:vortex-file-compressed +18.2% -16.3% +41.2% +30.0% 🚨 regression
21 datafusion:vortex-compact +13.9% -8.1% +23.9% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +4.6% -8.1% +13.8% +30.0% ➖ noise
21 duckdb:vortex-compact +10.7% -8.1% +20.4% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +7.1% -8.1% +16.6% +30.0% ➖ noise
22 datafusion:vortex-compact +36.4% +0.9% +35.3% +30.0% 🚨 regression
22 datafusion:vortex-file-compressed -29.4% +0.9% -30.0% +31.9% ✅ faster
22 duckdb:vortex-compact +29.8% +0.9% +28.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +33.0% +0.9% +31.9% +30.0% 🚨 regression

@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 2, 2026
joseph-isaacs
joseph-isaacs approved these changes Jun 2, 2026
View reviewed changes

@joseph-isaacs joseph-isaacs left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shall we make a symbols struct?

@AdamGS AdamGS marked this pull request as ready for review June 2, 2026 19:01
@AdamGS AdamGS merged commit d1b78c2 into develop Jun 2, 2026
85 of 86 checks passed
@AdamGS AdamGS deleted the adamg/bump-fsst branch June 2, 2026 19:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@joseph-isaacs joseph-isaacs joseph-isaacs approved these changes
@robert3005 robert3005 Awaiting requested review from robert3005
@a10y a10y Awaiting requested review from a10y

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@AdamGS @joseph-isaacs